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A.W.R. Carrothers, University of Calgary 



I accepted ihc honour of your invitation lo give this 
keynote address, not out of any conviction that I have any- 
thing new to say to you, but because I detected in the 
invitation a recognition of the contribution being made 
regionally, nationally, and internationally by the Office of 
Institutional Research at the university of which I happen 
to be executive head. That office was created in my fresh- 
man year as President not because 1 had any great vision of 
bringing the science of management to solving the myriad 
problems of today's universities, but because 1 was 
persuaded by our Director's advocacy that such an office 
could play a major role in bringing peace, order and good 
government to an institution the condition of some of 
whose affairs seemed at that time to range from the ridi- 
culous to the chaotic. Since then 1 have been persuaded on 
matters relating lo the development of that office, again not 
because 1 understood the case at any technical level but 
because I was persuaded by the record of the office that 
institutional research was a sound investment in ration- 
alizing structures, systems, and decision-making processes, 
A modern university in a modern world needs a 
mechanism that will provide relevant and accurate infor- 
mation to and about management. What 1 would like to talk 
about tonight is just that; the nature of the modern world 
which plays host to its universities; its significance to 
universities; the responses which an alert institution must 
bo prepared to consider; and what that means for the role 
which offices of institutional research will be called upon 
to play. 

A keynote address, as I understand it. is not sup- 
posed lo say anything new lo the conference participants. 
It should as best anticipate in a prosaic way the new ideas 
which the participants will reveal with professional clarity 
as the conference progresses. \ come from a profession thai 
spends much of its time in the past in the hope of antici- 
pating the present. Your profession lives largely in the 
future, using what you can of the past ~nd the present io 
determine what may be, in aid of those who must judge 
what should be. I therefore stand before you merely as a 
user's committee of one, I realize that this is an inter- 
national conference. 1 hope you will forgive me if I talk 
about the country with which I ought to be familiar. The 
problems may not be that different, but I do not presume lo 
lecture others on their affairs. 



University Dependence on Tax Dollars 

Of the 64 member institutions in the Association of 
Universities and Colleges of Canada I doubt that there arc 
half-a-dozen which have endowments of sufficient sub- 
stance thai they can consider private dollars as providing 
any significant discretion in planning and operating their 
affairs. The rest overwhelmingly arc dependent on tax 
dollars for their capital and operating budgets; even the 
proportion of income from student fees is going down as, in 
most jurisdictions, these stay frozen while costs rise. In this 
country, education is a provincial constitutional respon- 
sibility, and nearly all universities arc creatures of provin- 
cial statute. Since 1967 the federal government has 
reimbursed provincial governments 50% of operating costs 
incurred in all post-secondary institutions. This very sub- 
stantial federal commitment is based on the view that 
universities arc much more than educational delivery 
stations: that they have an important role in research, in 
other matters of national interest, and in the performance of 
national responsibilities in international and world affairs. 
In short, collectively, they constitute a very considerable 
national asset. 

The federal government had been involved in direct 
financing of universities on a per capita basis of provincial 
population for some 15 years prior to the 1967 cost sharing 
arrangements. The introduction of Ihc new open-ended 
scheme coincided with a number of changes that reinforced 
one another to push universities into almost a messianic 
role. You arc familiar with them: the explosion of basic 
scientific knowledge in Ihc post-war period symbolized by 
sputnik; the rise of a new technology, symbolized and 
represented by the computer; the emergence of the social 
attitude that education is the key to our salvation; the con- 
sequent inflation of individual expectations; the rise in the 
percentage of young men and women of university age 
seeking access co universities — known to (he boffins as 
"the participation rate." 

As North America turned into the present decade, 
dragging behind it an economic recession from the tag end 
of the 1960's. a backlash against universities set in. First, as 
I perceive it, came general al^rm over the escalation in 
cducalional costs, encouraged by prognosticators who pro- 
jected educational costs as rising above gross national 
income before the turn of Ihc century, coupled with 
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criticism from both business and labour that the world of 
learning was inappropriately remote from the world of 
work. Then came disillusionment from university graduates 
who could not find employment to their particular tastes. 
Then came an un predicted lcvclling-off in enrollment — 
I suppose what might be called a stabilization of the partici- 
pation rate. Then came a crisis in university management 
because institutions that were planning for growth and 
whose income related directly to enrollment could not 
balance their budgets. University dependence on tax 
dollars was no longer an hypothesis or an assumption or 
something one lived with, like earthquakes, birthdays, and 
other Acts of Cod; it was a brutal reality. Governments 
were not inclined to be moved by this new plight of the 
universities. Although informed members of the public, 
when they are reminded of it, arc in my experience 
basically sympathetic to the unique role which universities 
perform in society, when it comes to the allocation of tax 
dollars they arc very suspicious that there is fat in our 
budgets, and their suspicions arc reinforced by apprehen- 
sions or misapprehensions respecting such matters as 
tenure; sabbatical leave; teaching loads; the quality of 
research and the motivation for research: the comparative 
neglect of freshmen and sophomores; and the fact that the 
one thing that universities claim they cannot account for is 
how a professor actually spends his lime. I think also that 
there is recognition, more widespread than faculty may 
realize, that the freedom, of the academic community pro- 
tects other freedoms, and that a threat to the former 
deserves a response in the cause of all freedoms. Yet if 
those who influence public opinion believe that univer- 
sities arc in need of reform and arc unconvinced that 
universities have reformed, they will not put their weight 
behind the universities' plea for help over a mere financial 
crisis. 

At the present time universities arc struggling to find 
their place within a new range of choices among post* 
secondary institutions in an atmosphere of popular interest 
in the institutionalization of "life-long learning." a concern 
which could itself have a distorting impact on educational 
institutions and selection of goals. 

Increase in Government Interest in University Affairs 

Along with the increase in university dependence on 
tax dollars has come an increase in the level of curiosity by 
governments about what universities do in fact. Govern- 
ments arc interested in academic programs, in the rational- 
ization of graduate studies, in research policies and in how 
we manage our affairs. A new set of initials has emerged — 
H.Q.M. — Highly Qualified Manpower — which 
symbolizes government expectations of universities as they 
relate to economic interests and particularly to the market- 
place for university graduates. Universities have always 
been repositories of highly qualified manpower, and 
governments have frequently called upon university 
personnel to advise on a wide range of economic and social 
issues and to represent governments in international 



affairs. Now governments want to know what universities 
are doing on their own initiative and how their production 
of graduates relates to social need. That is the "new rele- 
vance." In the last 12 years virtually every jurisdiction in 
Canada has had a public enquiry and report on education, 
from the Parent Commission in Quebec to the Wright-Davis 
Report in Ontario. People now speak freely of universities 
as public utilities, and of education as a right. Yet there is 
conflict with that quality of autonomy which is essential to 
the performance of the universities' unique role in the 
quest for truth and between the individual's interest in a 
right to an education and the state's interest in highly qual- 
ified manpower planning. 

Most important of all. other social needs compete 
with education for the tax dollar, and heightened govern- 
ment interest in universities relates profoundly to the 
never-ending redetermination of public priorities. Educa- 
tion is a kind of experiment that failed to come off, and 
governments are not disposed to repeat it; they are looking 
elsewhere for success, 

The Challenge to Assumptions 

The environment of institutional dependence on 
substandial tax dollars and heightened government interest 
in what universities are doing, and therefore in what they 
should be doing, presents a challenge to virtually every 
conventional assumption about universities and their rela- 
tions with governments. 

Orthodoxy asserts that certain matters arc the prero- 
gative of governments, including the prerogative of creating 
public universities. LJy the same token, once a university is 
created, orthodoxy asserts that it takes on a quality tailored 
to its particular assignment of the quest for truth, wherever 
it may be found and in whatever direction it may take 
society, and the university has assigned to it an estate, 
that quality of independence, known as autonomy, com- 
mensurate to that task. Governments and universities, each 
in their own way, claim to serve the public interest. Never- 
theless, they never really have lived in worlds of their own, 
and they arc now, perhaps more than ever before, called 
upon to share the same path. May I be more specific, 

Basically the allocation of public resources to univer- 
sities is a government responsibility. Should universities 
be free to seek access to private resources? Has the private 
sector an interest in influencing the profile of public 
universities? Have governments a legitimate interest in the 
impact of such resources on the profile and capacities of 
public institutions? Should universities be free to assess 
student fees, or have governments a legitimate interest in 
education costs from the student viewpoint, to the extent 
that governments not only should control fees but also 
might consider the degree to which moneys conventionally 
made available fairly directly to institutions should be 
made available through the hands of the student? Should 
students, as they vote with their feet, carry tax dollars in 
their pockets? 

Who should go to university? Traditionally, univer- 
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sities have determined admission standards within the 
policy of the open door. With the growing abolition of high 
school leaving examinations as a result of government 
policy, we may be moving to a completely open-door 
system, in which the new expectation may be that everyone 
is entitled to be an unqualified success. Will the govern- 
ment pay the cost? Should the interest in a new control 
mechanism over quantity and quality, which is inevitable, 
be perceived as unilateral or as a shared responsibility? 

Heretofore governments have shown Ullk direct in- 
terest in how public monies, once allocated, are in fact 
used. Universities determined the internal allocation to 
general undergraduate studies, to graduate education and 
research, and to vocational or professional training. I am 
sure as you heard those words you recognized in these mat- 
ters a public interest of which governments may in- 
creasingly view themselves as stewards. 

Not long ago universities were the sole occupants of 
the post-secondary educational field. They could strive to 
be all things to all men, for they were all that men had. In 
fact the great strength of public universities in the western 
provinces, like the land grant colleges in the United States, 
tay in their close identification with the needs, desires and 
ambitions of large numbers of citizens in the post-high 
school level of education. Now universities are challenged 
to identify their particular role among a number of kinds of 
post-secondary institutions. We can no longer be all things 
to all men; if we try we will fail, and will be blamed for it. 
Should we now be planning a retreat to the ivory tower? 
Universities must recognize the issue of identity as their 
challenge; but again, we do not operate in isolation, if for 
no other reason than that what we can do may depend on 
what public resources are made available to us. 

I am no longer very confident when I use the terms 
short-, medium- and long-range planning, because I lack 
confidence in my judgment of their time spans. Yesterday's 
long range is often today's medium range and tomorrow's 
short range. But whatever long-range planning is. whatever 
may be the interest of the university in it, there is today an 
obvious government interest in it as well. The great un- 
certainty at the moment is how much planning is there 
likely to be or can there be and how is one to select the ob- 
jectives to which the planning is to be directed. The case 
for shared responsibility is increasingly obvious. 

Finally, we must reexamine the barricades of institu- 
tional autonomy and academic freedom, Are we any longer 
free — can we any longer afford to be free — to determine 
how to teach, how to carry out research, and how to 
organize ourselves to these tasks? Is there now a social in- 
terest in these matters as there is in what programs are to 
be offered, in the participation rate al both the undergrad- 
uate and graduate levels, and in the nature and extent of 
research? Have we not lost something of the legitimacy of 



decision-making in these matters that we used to enjoy? If 
we are right, as I believe we arc, in continuing to insist that 
autonomy is an essential concomitant of our unique social 
role in the quest for truth, a role which gives universities a 
life force of their own. is our stronger claim to autonomy 
and freedom in the areas of what, how, and whom to teach 
not that by nature they are ours absolutely but that we can 
better exercise judgment in respect of them? If so, must we 
not stand ready to account for our judgment? We Jre sensi- 
tive to the fact that in internal university affairs leaders are 
constantly called upon to authenticate their leadership by 
the quality of their judgment, and that nothing is accepted 
as settled so long as the merest morsel of argument has 
been left unsavoured. 

The Byzantine Condition of Post-Secondary Relationships 

An important component in the Canadian education 
environment today, in addition to the challenge to conven- 
tional assumptions, is the pluralistic nature of interests. 
The British North America Act allocates education to the 
provinces, at least in and for the provinces, whatever that 
may mean; and provinces create educational institutions 
called universities These in turn engage in activities 
beyond "education" in the constitutional sense, activities 
that naturally, properly and necessarily attract the interest 
of the federal government. Provincially created institutions 
congregate in a national association that is created, incor- 
porated and regulated under the aegis of a special statute of 
the parliament of Canada. Even two-year "community" 
colleges are formed into a national association. Faculty 
speak at provincial, regional 3nd national levels through 
their voluntary associations. Provincial ministers of educa- 
tion form themselves into a council with a central or 
national office. Research programs of universities, parti- 
cularly in the natural and health sciences, are heavily 
influenced by national funding agencies and government 
departments, a matter that increasingly is attracting the 
interest of provincial governments in respect of programs, 
financing, and "rationalization," Research of course is 
interrelated with graduate studies and the production of our 
new acquaintance "highly qualified manpower," clearly 
matters of shared interest. Even learned societies, which 
heretofore functioned as genteel and scholarly academic 
guilds, are in particular cases politicizing themselves and 
setting themselves in judgment over certain forms of 
managerial activity. 

The Interna) Impact of the New Environment 

The new challenge to old assumptions and the 
pluralistic nature of the educational environment are 
having their impact on the internal affairs of universities. 

To begin with, faculty today feel threatened as they 
have never felt since the depression of the 1930 s, which 
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means for practical purposes, such being the nature of the 
memory of man, as they have never felt before. They have 
been exposed to the policy of shared responsibility and 
they arc disillusioned with it, for the results arc not all that 
different from the bad old days of ' authoritarian' 1 rule. 
They are affected personally by the institutional identity 
crisis. It is a s'lort distance from being threatened in one's 
employment ta questioning the worth of (he job. Faculty 
are mindful t.f the uncomfortable trade-offs at stake and 
their impact on individual economic and professional well 
being. 

Their response is a highly predictable surge in the 
direction of collective bargaining. Whether collective 
bargaining comes as a matter of volition or as a matter of 
law, a great many things must be sorted out. When the 
mechanics are squared away, issues of mutual trust have 
been resolved, and the real bargainers identified, there still 
remains the fact that effective collective bargaining 
depends on the availability of data that both parties accept 
as relevant, reliable and complete. I shall return to this in a 
minute. 

At the level of institutional management the chal- 
lenges of the new environment are shaping behaviour. 
Undoubtedly hard times have a centripetal impact. So does 
the policy of planning. So does the policy of accountability, 
for no sane person will accept responsibility for a matter 
beyond his control. So does the wilfullness of politics, 
because in an environment of unpredictability 
individualism will be surrendered for the protection to be 
sought in the herd. 

1 think it overstates the response to assert, as some 
would, that there has been a failure of nerve within institu- 
tions. I think it may be fairer to say that they are driving 
defensively. There certainly has been a loss in the political 
base of institutions. There also has been an escalation in 
the rate of turnover in administrative personnel that 
followed the adoption of term appointments in conjunction 
with the mechanisms of shared responsibility between 
faculty and administrators in the mid-1960 s. The question 
must be faced whether there is an adequacy of leadership 
trained to the problems of politics, collective bargaining, 
systems management and public accountability, combined 
with the competing demands of "shared responsibility" 
and conventional academic management and, hopefully, 
academic leadership. 

Two matters are of greatest concern to universities in 
the t070's. One fear is that they will be reduced to a subsis- 
tence level of performance because of a substantial reduc- 
tion in public priority given to this component of higher 
education. The other is that universities will be politicized 
as a consequence of a substantial rise in the level of 
governmental interest in what they do in fact, not simply 
because of the demand for accountability of governments, 
which inevitably passes on to iax supported agencies and 
O 
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institutions, but also because of a rising interest by govern- 
ments in the utilization of the expertise reposing in our 
universities in the search for solutions to the increasingly 
complex issues facing governments today. 

The Need for Interaction 

The convoluted nature of our relationships is not 
going to be resolved, and the modern challenges to conven- 
tional assumptions are not going to disappear, We need to 
learn to manage our environment, or at leasl to manage our- 
selves in our environment. If universities have lost a 
measure of public confidence and hence a measure of the 
confidence of governments, so also is there rising appre- 
hension within universities that they are to be exposed to 
prejudicial government policies created without an oppor- 
tunity for them effectively to influence the determination of 
policies and their execution. That is the current "crisis of 
confidence." It is basically a crisis of communication. I 
have on another occasion used the analogy of a roomful of 
cuckoo clocks; when each clock thinks its time has come a 
bird pops out, has its say, and pops back in, quite indif- 
ferent as to whether it has been heard and quite unin- 
terested in listening to others. Governments, universities 
and the public whose interests we both claim to serve 
desperately need to develop a philosophy of communi- 
cation, a commitment to interaction, and from that to 
develop processes, or, to use current planning argot, an 
"effective interface." through which assumptions can be 
reviewed and progress made toward identifying and attain- 
ing long term objectives, by which we can influence our 
future. We cannot live by hidden controls and cryptic 
messages. Governments and universities together must 
resolve the uncertainties and minimize the risks of present 
unstable conditions. Universities must be prepared to do 
their homework, and governments must be prepared to 
treat them with candour. Neither governments nor univer- 
sities can afford to be taken by surprise. 

Above all there is need for mutual recognition of the 
problem of processes as it affects governments and univer- 
sities today. Where there is recognition of objectives, how- 
ever easy or uneasy those objectives may rest on the 
partips, it is comparatively easy to deal with processes. But 
where assumptions and objectives are subject to serious 
questioning, there is put into issue not only the role of 
universities, not only the role of the state, but the whole 
role of education in society over whatever planning span 
we may think vve have or may in fact be given to us. The 
problem of processes therefore is the problem of how the 
parties arc to live together in their condition of unsettle- 
mcnt and how the parties are to manage the interrelation- 
ship of processes and the identification of educational 
objectives and their priorities through the reconciliation of 
competing interests. Throughout must be recognized the 
risks attendant upon planning — not merely that planning 
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will be bad in the sense of less than competent, but that the 
clearer the planning the more obvious who will have and 
who will have not; who will benefit from the planned 
condition and who will perceive his destiny in rebellion 
against it, rebellion, hopefully, within the political process 
itself. Throughout must be recognized the disparate nature 
and function of governments and universities in our kind 
of society, and the legitimate role of institutional autonomy. 

The ad hoc committee on planning of the Asso- 
ciation of Universities and Colleges of Canada, of which 
many of you are members, was created toward the end of 
the 1960's with the intent of being concerned primarily 
with physical planning. When the boom went out of uni- 
versity growth the committee, at a conference at Lakchcad 
University in 1970, which was inward looking and philo- 
sophical in nature, turned to the interrelationship of 
physical and academic planning. A further conference was 
held at the University of Calgary in 1972 at a more technical 
level, addressed particularly to the development of manage- 
ment information systems. In November, 1972, the com- 
mittee met with its advisory committee, and shortly there- 
after it brought to the Board of Directors of the Association 
a three-phase plan for grappling with the problem of 
developing an effective interface with governments. The 
Board adopted the plan enthusiastically. Phase one, which 
called for executive action, was completed in short ordrv 
Phase two took place in mid-March of this year. It consisted 
of a workshop of some two dozen persons, drawn from 
federal and provincial governments, universities, business 
and labour, to consider in a comparatively unstructured 
way these issues relating to the development of processes. 
Many of the points 1 have sought to make today came out 
clearly in that very intense and stimulating day and a half. I 
know { gained from it. 

The workshop resolved that as a next step the 
committee should "assess the processes for planning long 
term development for universities in Canada with special 
attention to interactions of institutional, provincial, regional 
and national authorities.*' That step should be completed 
shortly, and as President of the Association 1 have asked 
the committee chairman to couple his report with proposals 
for the next phase in the exercise, f tell you this because I 
think it is worth noting than an ad hoc committee 
originally created to concern itself with physical planning 
expanded its mission to include the union of acaJemic, 
physical and fiscal planning, and was instrumental in 
Inciting the Association of Universities and Colleges of 
Canada to provide leadership in grappling with the new 
and critically important problem of processes. 

The Role of Institutional Research 

I have been talking about the processes of planning 
within universities, between universities, within govern- 
ments, between governments and between governments 
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and universities. That is emerging as the educational 
challenge of the 1970*s. If it is not approached at the highest 
level of sophistication the game will be rough and public 
opinion may be a poor referee. Some may have no stomach 
for the game, which is understandable. Others may find 
their durability tested. Participants who are highly 
dependent on job satisfaction for a sense of personal well- 
being may be hard pressed to find alternative sources. 1 see 
institutional research in the 1970 s as playing a major role 
of reinforcement to those who are charged with developing 
an effective planning interface between governments and 
universities. You are the staff, the boffins, the experts. You 
need not be reminded that you are not the policy makers; 
but you arc the constants in the process of policy making, 
and you can be of major use in reminding administrators of 
what they need in supplying policy. We must be masters in 
our own house; we must be masters of the facts about our- 
selves, for only then will we be able to demonstrate our 
competence and thus to legitimize our claim to autonomy. 
At the political level you have no visible role, but again you 
can and must back up administrators with accurate and 
relevant information. 

Until now institutional research has been meeting an 
institutional demand for costing services respecting the 
acquisition and allocation of capital and operating 
resources, ft has served a need for systems development not 
only at the institutional level but at provincial and federal 
levels as well. It has met myraid ad hoc requests, and in 
the process it has taught administrators a thing or two about 
asking the questions they really want answering and asking 
them in an answerable form. 1 personally have the greatest 
respect for your collective perspicacity and accomplish- 
ments. 

I think you now face a number of specific demands 
as you practice the applied science of systems engineering. 

PPBS (Program Planning Budgctting Systems) is 
likely to be with us for a very long time. It requires 
particular adapation to university management, but govern- 
ments have adopted and adapted it and we must continue 
to do the same. It will, as I see it, involve the process of 
prediction over a wide range of facts; the development of 
more and more sophisticated allocation models for 
operating resources: and the continuing refinement of the 
techniques of cost benefit analysis. 

You doubtless will be called upon to provide data 
relating to the inter-institutional rationalization of research 
and graduate studies, and once again you may have to teach 
your interrogators how to ask the right questions. 

The move to collective bargaining could well shift a 
special burden to institutional research. The negotiation of 
terms and conditions of employment is likely to raise issues 
quite distinct from those to which institutional researchers 
are accustomed. Perhaps the most important matter is 
whom are you there to serve. You understand now that 
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your duty is to apply your professional competence and 
standards to the institution, and you need not distinguish 
between the components of the institution. The answer to a 
question respecting a cost study does not depend on the 
identity of the questioner. If you can preserve that virtue in 
responding to demands for information to be laid on the 
bargaining table, you will be performing the best possible 
service to the institution as a whole. If facts are to resolve 
issues at the bargaining table they must be above reproach, 
On this i shall say no more for fear of saying too little. 

institutional research has always been an important 
contributor to academic planning. Today universities face 
particular issues in academic planning in the areas of 
continuing education and the concept of the open univer- 
sity. Here the university confronts a broad spectrum of 
social needs, from the conventional academic program, to 
professions) refraining, to learning for leisure. We face 
major policy decisions. The burden will be made lighter by 
the availability of information respecting the educational 
marketplace. 

There is a growing demand for management 
development programs for academic administrators. It has 
been my observation and experience that management con- 
sultants, in bringing their talents to bear on educational 
management problems, are extremely useful, for a profes* 
sionally trained outsider can perceive deficiencies and 
design solutions which the insider cannot grasp on his 
own. But their models, which tend to be derived in the first 
instance, and often directly, from private enterprise, a very 
natural prototype for management science, will bend only 
so far to the needs of universities. The institutions must 
reach out to bridge the gap between the capacities of 
professional consultants and the particular needs of educa- 
tional institutions. Those in institutional research may be 
called up to do just that. 

Your particular forte is the development of 
management information systems. Information is the first 



step to planning. Planning implies control, and control 
implies a pecking order. You will be in the eye of this 
hurricane of systems development; and you will be called 
upon to share the product o? your skills with other insti- 
tutions, and to develop a coordinating apparatus. 

Earlier in this address 1 referred to a number of 
conventional assumptions that are being challenged. I also 
suggested, more than once, that universities should take the 
initiative In stating the issues and proposals for their 
resolution. The universities should accept that onus and 
State their policies on such matters as size, participation 
rate, programs, financing and similar matters which add up 
to a statement of fairly concrete objectives. That at least 
would give a basis for dialogue with governments, and in 
the performance of the exercise it is conceivable that some 
problems might be identified and resolved and a number of 
questions might disappear. Then we will know that the 
residue contains the issues that need a lot of hard work. 

1 have been talking about the challenge* and the 
crises of the decade of the 1970*s. A hundred years from 
now what will be the centre of the university will not be 
the problems of administrators or the role of institutional 
research, It will be the liberal arts — not medicine, not law, 
not engineering, but the study of the nature of man. 
Furthermore, education is an instrument of social progress, 
and that will carry the day. The unique role of the univer- 
sities will still be the quest for truth. That quest calls for 
rationality, which in turn establishes the role of rationality 
in management. That is the particular role of institutional 
research; that and the understanding of the limitation of 
rationality, for you must not let us quantify the unquanti- 
fiable. Institutional research is the new buffer between 
universities and the shifting forces of politics. "The price of 
liberty is eternal vigilance;'' and a university must be "a 
place of liberty. " We look to you, the professional 
rationalists, to bring a new vigilance to the challenges of 
our time. 
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For several years, I have been brooding over the 
question of how higher education ought to be financed. I 
have been struck by disparity between American practice 
and that in most parts of the world. Most nations admit to 
their universities a smaller percentage of their population 
than we do, but once having admitted them they offer 
higher education without tuitions and often with heavy 
subsidies for living expenses. In the United States, on the 
other hand, we are constantly raising tuitions and are 
shifting more and more of our student aid from giants to 
long-term loans. 

I have also been struck by what seems to be a radical 
change in American attitudes about higher education. For 
at least a century higher education has been regarded as a 
form of personal opportunity for the sons and daughters of 
tow-income families. It has been thought therefore that it 
ought to be made available on the most generous terms. 
This, I have thought, was the idea underlying the Morrill 
Act, Ihe establishment of the public urban colleges, the 
community college movement, and the GI Bill. I myself 
attended a state collegn (not far from Vancouver) which 
had open admissions, no tuition, and living costs so tow 
that virtually anyone could get through. Why, I have asked, 
at this particular stage in our history when we still have the 
task of bringing millions of young people into Ihe main 
stream of American life — many of them from ethnic 
minorities — are we suddently shifting to high tuitions and 
long-term loans? Have we been misguided over the years 
and are we just learning about our mistakes? Or are we 
now committing a colossal blunder? 

The puzzle is perhaps especially acute for me 
because many of the members of my own profession, econ- 
omics, have been among the chief advocates of high 
tuitions and student aid in the form of loans. Thier view- 
point derives in part from the economists' traditional love 
affair with the market as an allocator of resources and their 
suspicion that Ihe finance of higher education through the 
tax system represents an adverse redistribution of income. 

As I have pondered these questions over the past 
five or six years, my ideas have evolved considerably. I 
have come to realize that the issues in the financing of 
higher education are primarily matters of value rather than 
of technique. The higher education system serves a multi- 



plicity of goals. Some of these goats are mutually 
incompatible aud :.omc are assigned different priorities by 
different persons. Each of these goals when viewed in 
isolation calls for a somewhat different kind oi financing. 
When these goals are viewed collectively, they call for a 
mixed system of finance not unlike that which currently 
prevails. The present system can be viewed as the product 
of the complex cross-currents of American politics. The 
system is not tidy; it is based on no single ideology; it is full 
of compromises; it is hard to understand; it fully pleases no 
one; it is likely to change through gradual evolution, not 
through radical departures. The basic policy question is: In 
what general direction should change be tending? 

In my remarks tjris morning, I shall try to identify 
some of the goals that are sought through higher education 
and to explore their implications for financing. 

Economic Growth and National Military Power 

A major goal for higher education is nation econo- 
mic growth. Many studies, as well as common sense, have 
indicated that learning in a wide variety of fields adds 
to the productivity of labor and that the kinds of basic and 
applied research conducted in universities also enhance the 
national product, Moreover, the connection between learn- 
ing and national military strength has been widely recog- 
nized especially since World War II. Indeed, the revival of 
interest in higher education in the 1950's was sparked by 
the launching of Sputnik; the major breakthrough in federal 
educational legislation of (hat period was called the 
National Defense Education Act; and one of the major 
complaints of students during the height of the Viet Nam 
War was that higher education had become a tool of the 
Military Industrial Complex. 

The goal of national economic growth calls for 
federal financing of higher education partly in the form of 
general support and partly in the form of categorical grants, 
loans and contracts intended to encourage particular kinds 
of training and research. Categorical support results in 
eve: changing emphasis in federal programs a* old needs 
arc fuelled and new needs discovered. It tends to put 
universities in the position of producing for a **markef in 
response to rapidly changing demands of the federal 
government, and removes some of the decision-making 
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from the campus to Washington, 

Supply of Professional and Other Skilled Persons 

Another goal is simply to provide an adequate 
supply of professional and other skilled persons to serve 
the population. Society requires a reliable supply of 
physicians, dentists, nurses, teachers, lawyers, clergymen, 
accountants, engineers, soldiers, etc., just to take care of its 
elemental needs. Even in the founding of Harvard, the 
supply of professional workers, specifically clergymen, was 
a dominant consideration, and many of the state colleges 
were originally founded as normal schools to provide a 
supply of teachers. 

Historically, because professional people weie 
scarce and because some of the professions offered low 
enumeration, this goal called for a system of finance that 
would encourage students lo enter the professions: low tui- 
tions and student aid in the form of grants. Today, except 
in the health fields, the scarcities have apparently been 
largely overcome, and in (he health fields incentives are 
strong because renumeration is high. So (he need of special 
financial arrangements to encourage the supply of 
professionals is less strongly felt (han it was in earlier 
generations and this goal probably calls for no special 
financial arrangements. 

Citizenship and Civic Leadership 

An American article of faith is that widespread 
education wilt produce an intelligent, informed, and 
responsible electorate. The drive toward universal second- 
ary education nearly a century ago was promoted with 
citizenship as a major goal. Today the claim is made that 
near universal education for two years beyond high school 
can be justified on the basis of its contribution to 
citizenship. 

This position suggests that education in the first two 
post-secondary years should be tuition-free or nearly so. It 
also suggests that after the first two years the private 
benefit from higher education exceeds the social benefit 
and that substantial tuitions, or even full-cost tuitions, 
should rule for the upper-division, graduate, and profes- 
sional years. 

This position also rests on the argument that once 
students have experienced two successful years of college, 
have discovered their interests and abilities* and have 
appraised their opportunities, they should then be able to 
judge the private benefits of further education and should 
be Willing to proceed under a system of high tuitions 
backed up by long-term loans. 

This general view represents a neat compromise 
between those who would make higher education at all 
levels essentially tuition-free and those who would charge 
full-cost (or nearly full-cost) tuition at all levels. 

Some uneasiness about the citizenship theory e ises 



from the fact that many of those who favor wide extension 
of higher education in the first two post-secondary years 
arc thinking of voco'ionol rather than general education. 

The citizenship proposal can also be questioned on 
the ground that citizenship may be advanced as much by a 
highly-educated civic leadership as by mass higher educa- 
tion at grades 13 and 14. The interests of the body politic 
might call not only for education on the part of the many 
but also deep education on the part of the few (but not too 
few). Society in seeking good citizenship may be justified 
in subsidizing education in the later as well as earlier 
college years. 

Solution of Social Problems 

A persistent goal of higher education is to provide 
the knowledge and the personnel to cope with social 
problems. Today our society has an especially wide array of 
felt social problems most of which are ntaional in scope 
and import, We wish to conquer poverty, achieve racial 
justice, renew our cities, restore order, improve health 
education renew the environment, develop the arts, keep 
the peace, restrain world population growth, and aid 
developing nations. These tasks will require great bodies of 
new knowledge and great cadres of dedicated and profes- 
sionally competent persons. They will stretch our resources 
in educated, sensitive, insightful people. Education and 
research arc still our main hope for coping with these 
problems. 

Solutions call for citizenship education of the many 
and liberal and professional education in depth of the 
indespensable technical and political leadership. Solutions 
also require research and scholarship in the natural 
sck ices, ihe humanities, and the social studies. 

An adequate attack on our national social pro- 
blems would seem to call for broad federal support and 
encouragement of all aspects of higher education, not 
merely the first two years, not merely research in the 
natural sciences, and not merely mission-oriented programs 
of education and research. But in addition to broad general 
support, it would also require categorical aids to foster 
particular kinds of research and tnining. 

Responsiveness to Social Needs 

The allegation is often made that colleges and univer- 
sities depend upon public support but are not responsive or 
accountable to any constituency. It is said that they are 
insensitive to the needs of the government, to the interests 
.of their students, to the wishes of the various publics they 
serve, and to the broad social interest. [| is argued that 
their governance and finances should be changed to make 
them more responsive. 

No one can reasonably deny that colleges and 
universities exist to serve their society and that they have a 
deep obligation to work toward advancement of the 
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genuine interests of that society. The question is: How can 
this social responsiveness be best assured? 

One way that is often advocated is to finance institu- 
tions through the price system. Instruction would be finan- 
ced through tuitions received from students; auxiliary 
enterprises would be financed through fees to cover costs 
including capital costs; public service activities would be 
financed through payments from individuals, corporations, 
and public agencies receiving services; research and 
scholarship would be financed through grants or contracts 
from individuals, corporations, and public agencies. In this 
way, higher education would concentrate on those specific 
activities which someone on the outside would deem worth 
paying for. The distinction between proprietary and not- 
for-profit institutions and between public and private insti- 
tutions would then largely disappear. 

In recent decades, the system of higher education 
has moved perceptibly toward the market model. Contract 
research has become commonplace, tuitions and other fees 
have risen and services of auxiliary enterprises are 
increasingly priced at full-cost. 

Another way of increasing responsiveness has been 
to alter the governance of institutions by subjecting them to 
site visits, inspections, audits, and reports, by placing them 
under the supervision of public coordinating bodies, and 
by direct legislation affecting programs, tuition, salaries, 
teaching loads, tenure, etc. 

A question may be raised as to whether the 
"customers'* on the outside are belter able than the facul- 
ties and administrators on the inside to determine what is 
in the social interest. Concern for the long-run interests of 
students is surely a responsibility of the college and univer- 
sity, but it does not necessarily follow that better educa- 
tional decisions will be made if students control a large 
part of the income of colleges and universities than if 
educational funds derive from unrestricted appropriations 
and gifts. Similarly, research and scholarship should 
promote the long-run interests of society, but it does not 
follow that better decisions about the development of 
science, the advancement of knowledge, and the eniich- 
ment of the culture will be made by outside individuals, 
public agencies, and corporations than will be made by 
faculties. Even in the case of public services, it is not self- 
evident that outside groups are bound to be right about the 
kinds of public services that are compatible with the total 
program and mission of colleges or universities. But to the 
extent that greater responsiveness to outside decision- 
making is sought, increasing finance through tuitions, fees, 
contracts, categorical grants, etc., is one way of achieving 
the goal. 

Efficiency 

In recent years, the opinion has become widespread 
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that higher education is conducted inefficiently, and effic- 
iency has been advanced as a major goal. 

At the most global level, efficiency refers to the 
proper allocation of total resources to higher education so 
that the benefit from the last dollar allocated will be as 
great as the benefit from the last dollar spent for other pur- 
poses such as private consumption, urban improvements, 
domestic transport, military operations, etc. The argument 
is sometimes made that there are too many students 
enrolled, too large a research establishment, too many 
public services, etc., and that the growth of expenditures 
should cease until balanced margins are restored. 

A second concept is that the scope of the enterprise 
may not be too great, but that higher education does not 
produce as much return from its total expenditures as it 
might. It is often alleged that it has surplus plant, the school 
year is too short, teaching loads are too low, the pace is too 
slow, technology is backward, and managerial technique is 
slack. By internal tightening up, it could allegedly produce 
a greater return at the same cost. 

A third concept is that resources arc not allocated 
properly among the various branches of higher education, 
among the various fields of study, between undergraduate 
and graduate instruction, or between teaching and research. 
For example, too much attention is given to academic 
studies and not enough to vocational studies, too many 
students are enrolled in expensive universities and not 
enough in community colleges, graduate study and research 
are being overdone, too few MD.'s are being produced, too 
much attention is being given to theoretical and esoteric 
subjects and not enough to practical and applied subjects, 
etc. 

An inherent difficulty resides in these allegations 
about efficiency. Though the inputs can be measured both 
physically and in dollars, the outputs or outcomes arc 
largely non-measurable except through intuitive judgment. 
People of equal knowledge and integrity can reach quite 
different opinions. Devices such as cost-benefit analysis 
and program budgeting are not of much help when the 
benefits are so hard to identify. Even comparative cost data 
from different institutions are hard to interpret because 
programs are not the same and qualitative results may be 
quite different. 

The efficiency question looks quite different to 
many educators from what it does to outside legislators or 
businessmen. Educators see an educational establishment 
of rapidly growing enrollments where society is continually 
loading on additional responsibilities, where faculty are 
working long hours, where academic standards have been 
rising and the richness of education has been increasing 
despite inadequacy of funds, where the academic quality of 
education and research is as high as anywhere in the World, 
where there is a perennial shortage of administrative and 
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non-adadcmic staff lo get the job done, and where financial 
precariousness is a way of life. The educator sees higher 
education as being under-funded in relation to the enor- 
mous tasks to be accomplished and in relation to the 
returns being yielded by expenditures for other private and 
public purposes. He sees higher education as comparing 
very favorably in efficiency with many segments of private 
business, with the health services industry, with local 
government, with federal agencies, with private founda- 
tions, and with the use of resources by private consumers. 
He sees his duty, in quest of efficiency, to seek more funds, 
not to cut back. 

Educators are, of course, not the best judges of their 
own efficiency, and some external check is reasonable. 
One possibility is simply to slow up the rate of increase of 
expenditures and thus force institutions to cut back their 
expenditures of lowest priority until the "fat" has clearly 
been squeezed out. Another possibility is for a coordinating 
agency or some other public body to set standards of 
expenditure per student perhaps on the basis of cost 
analysis, and to limit appropriations accordingly. The third 
is to rely on the price system — to allow competition to 
force institutions to hold down their costs to reasonable 
levels for the kind of service they are rendering and to 
charge high enough tuitions so that students will not utilize 
educational services in which they are not genuinely 
interested. One of the arguments often advanced for 
converting higher education to the market system is that 
efficiency would be promoted. 

Minimizing the Scope of Government 

A set of related goals are: (1) that government should 
not engage in activities that can be conducted privately, (2) 
that public subsidies should be used sparingly, (3) that 
public budgets should be balanced, and (4) that the price 
system has special merit as a device for allocating 
resources. These opinions of course lead to the view that 
higher education should be financed through tuitions and 
that students should be financed through loans. 

One important technical fact about loans for the 
financing of students is that loans can be financed through 
the private capital market and need not show up in public 
budgets. Except for this fact the global economic effects of 
loans and grants are not very different. In either case, the 
funds are likely to be supplied by financial institutions, 
and later repayment constitutes a mere transfer. The 
economic cost of current higher education cannot be trans- 
ferred to the future. 

Equity 

An important goal is equity among individuals and 
among social classes in the distribution of the benefits of 
higher education and in the distribution of the costs. In the 
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distribution of benefits, wide and easy access of all classes 
of people to higher education of all types is perhaps the 
only requirement for equity. In the distribution of costs, the 
equity problem is more complex. 

A common assumption is that costs should be distri- 
buted in some fashion between the student (and his family) 
and society (as represented by government and phil- 
anthropy). A reasonable basis of the division is often said 
to be bene/it. The student should pay an amount corres- 
ponding to his private benefit in the form of life enhance- 
ment and increased earning power, and society should pay 
in proportion to social benefit. This formulation, however, 
presents difficulties because of differences of opinion not 
only about the relative extent of private and social benefits 
but also about what should be included in the costs. 

As the economist sees the costs, they include: (1) 
foregone income by reason of the student's being in college 
and not in the labor market, (2) incidental expenses of 
college attendance, and (3) institutional costs of providing 
educational services. 1 estimate the amount of these costs 
(annually per student) as follows: 

Amount Percent 

Foregone income $5,000 55% 

Incidental expenses 500 6 

Institutional costs 3,000 39 

$9,000 100% 

The question is: What proportion of this $9,000 should be 
borne by the student and what portion by society? 

Suppose one were to assume (as seems reasonable to 
me) that two-thirds of the benefit were private to the 
student and one-third were social. Students on the average, 
then, should bear about $6,000 and the public about $3,000. 
The $6,000 would be met if the student gave his time to the 
educational enterprise, paid for his incidental expenses, 
and contributed about $400 in tuition. Obviously the 
assumptions on which this result rests may not be univer- 
sally acceptable, But for what these assumptions may be 
worth, they suggest that a major part of institutional costs 
should on grounds of equity be paid from appropriations 
and philanthropy. 

Those who discount the social benefits from higher 
education and who reject the idea of foregone income will 
come to quite different conclusions. Indeed, differences in 
the interpretation of social benefits and foregone income 
underlie much of the conflict of opinion about the finan- 
cing of higher education. 

Equity in the distribution of costs also concerns fair- 
ness as between students who have affluent families to 
assist them and students who do not. If one assumes that 
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students arc emancipated and that family income is not a 
consideration, then all should be treated alike. Either loans 
or grants would be appropriate, On the other hand, if one 
assumes that families when able are responsible to support 
their children in college, then fairness may require that the 
government and philanthropy act as surrogate parents for 
students whose families are not able to help. This would 
argue for grants rather than loans to needy students. 

Still another equity issue concerns intergenerational 
fairness. The American tradition of higher education has 
encouraged low-income students to attend by means of low 
tuitions, modest scholarships, and part-time work. Under 
this system, generations of young men and women of low- 
income families have attended college without piling up 
lifelong indebtedness. We arc now in the process of bring- 
ing another generation of young people, many of them 
minority origins, into the mainstream of American life via 
college. Is it fair to change the rules for this new group by 
requiring them to go into debt? 

Considerations of equity on the whole favor a system 
of finance based on low tuitions coupled with grants rather 
than loans to low-income students. 

Tempering Inequality in Income Distribution 

A goal that is seldom mentioned directly but often 
implied is to use the higher educational system as a vehicle 
for reducing inequality in the distribution of income. The 
distribution of Income is affected by higher education in 
two ways. 

Higher education can influence the distribution of 
income directly because it takes money from taxpayers and 
spends it on studer.ts. If the taxpayers are on the average 
richer than students, income distribution will tend to be 
equalized; if the taxpayers are poorer than students, 
inequality will be accentuated. The conclusion is that either 
the tax system should be made more progressive or tuitions 
should be raised. 

A more fundamental influence of higher education 
in income distribution derives from its long-run effect on 
relative wages and salaries.of various classes of the popula- 
tion. If the percentage of the population attending higher 
education continues to grow, the supply of persons avail- 
able for professional, skilled, and white-colar occupations 
will increase, and the supply available for blue-collar and 
unskilled occupations will decrease. As a result, the rela- 
tive compensation of the two groups will change, and the 
distribution of income will become more equal. To achieve 
this result calU for a system of finance that encourages 
access, namely low tuitions and grants to students. 

Access and Opportunity 

One of the most widely-held goals of American 
higher education is that young people, regardless of their 
circumstances, should have access to as much higher 



education as they are qualified for and motivated to obtain, 
Today, this principle is being extended to adults of all ages 
and demands are being made for lifelong access. This goal 
of widest possible access is based on the ideas that access 
is tantamount to opportunity, both cultural and economic, 
and that widespread higher education will foster economic 
growth — through discovering talent, sorting people out 
according to their interests and abilities, and developing 
vocational skills, it rests also on the conviction, supported 
by considerable recent evidence, that the innate ability to 
benefit from college education is much more widely distri- 
buted than had previously been believed, and that new 
kinds of higher (or post-secondary) education could be 
devised lo accommodate a large proportion of the popula- 
tion. This goal of access accounts also for the recent drive 
for "open admissions." 

If access were the sole objective, it would call for a 
system of finance with institutions funded primarily by 
public appropriations and philanthropy and only second- 
arily by tuitions and with needy students funded primarily 
by grants and only secondarily by loans. However, as an 
alternative, access would not be curtailed very much if 
institutions charged high tuitions but needy students were 
assisted by correspondingly large grants. 

Student Freedom 

In recent years, the position of college students in 
our society has changed markedly. They are increasingly 
regarded as adults, they arc given greater liberty in their 
ways of life, they vote, and paternalism on the part of both 
parents and educational institutions is on the wane. One of 
the goals of higher education today is to maintain or 
increase the newly-won freedom and independence of 
students in their selection of colleges, in their choice of 
courses and educational programs, in the mode of instruc- 
tion and learning to which they are exposed, in their 
pattern of living, and even in their relations with their 
parents. 

This goal calls for the finance of institutions through 
tuitions and the finance of students through grants or loans 
directly from government to the students, not via instit* 
utions. If students are the chief vehicle for bringing funds 
to the colleges, and are free to select colleges of their choice 
they will acquire substantial power over the educational 
process. Colleges will be forced to be attentive to student 
opinion and need. 

The goal of student freedom also raises questions 
about the relation of students to their parents. In general, 
America has accepted the idea that parents are responsible, 
to the extent of their means, to finance the education of 
their children. But if the children arc to bo free and to be 
regarded as adults, they should at some point be emanci- 
pated from their parents. Should the time of emancipation 
be at ago IB? Age 21? At graduation from college? At 
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completion of graduate and professional education? 

America has been equivocal on this subject of eman- 
cipation. In pcncral, graduate fellowships and assistant- 
ships have been awarded without a parental mean* test, 
whereas undergraduate awards have usually involved a 
means lest. Yet, the G.I. Bill, one of our most far-reaching 
and successful student aid programs assumed that the 
veterans were emancipated from their parents regardless of 
age. In the past, when credit has been used to finance 
college education, parents have usually been the respon- 
sbile borrowers. But recently, as Ihe use of credit has been 
increasing, the students are often assuming the respon- 
sibility of repayments, A persuasive argument for Ihe 
newer loans of substantial amounts, long maturities, and 
contingent repayment features is that such loans make 
possible the emancipation of the student. Grants of equal 
amount would, of course, give them even greater freedom, 
but grants of equal amount are not likely to be forthcoming. 

A more subtle aspect of student freedom is that the 
student should be free to choose his field of study without 
arbitrary admissions and retention standards, without 
arbitrary quota systems, and perhaps without differential 
tuitions for different disciplines. According to this view, 
the higher educational system should be responsive to Ihe 
informed choices of students and not be managed by 
means of arbitrary admission restrictions and quotas 
designed to regulate the flow of people to different fields 
presumably in accordance with estimates of future man* 
power requirements. The case of medicine is often cited as 
a field that presents arbitrary barriers to thousands of well- 
qualified men and women who would like to become 
physicians and who are needed in the health service 
system. According to this concept of freedom, the higher 
education system should be planned primarily with the 
demand for places on the part of qualified students as the 
principal criterion rather than arbitrary estimates of profes* 
sional associations, manpower planners, etc. A possible 
financial implication of this point of view is that the 
charging of different tuitions for different fields of study 
would unduly influence choices because relatively small 
sums of money might weigh heavily in the short run and 
produce bad decisions for Ihe long run. A contrary 
viewpoint is that tuitions should, in the interests of 
efficiency, reflect the relative cost of different educational 
programs. 

In general, student freedom probably calls for a 
financial system of high tuitions coupled with generous 
loans available without a means test and free choice of dis- 
cipline without large fee differentials. 

Academic Freedom 

A venerated goal of higher education is academic 
freedom. This refers not alone to the right of professors to 
seek and speak the truth; it refers also to the power cf 



faculties individually and collectively to decide what lines 
of research and scholarship to pursue, what to teach, how 
to teach, what standards to maintain, what public service 
activities are compatible with the main business of instruc- 
tion and scholarship, etc. The assumption has been that in 
all these malters professional judgment comes into play. 

Obviously, professional prerogatives do not justify 
social irresponsibility. On the other hand, there is no sub- 
stitute for professional judgment in most educational and 
scholarly decisions. One of the inescapable problems of 
academic life is to achieve a reasonable balance between 
social control and academic control such that the genuine 
long-run interests of society are advanced. A major task of 
college and university presidents is to bridge the distance 
between the academic interests and the interests of the 
society beyond the campus. There is no simple solution to 
the problem, but the solution clearly does not lie in 
destroying academic freedom, in making the university a 
government bureau or market-oriented enterprise. To 
preserve the essentials of academic freedom, colleges and 
universities must have substantial unrestricted funds from 
appropriations, gifts, endowment; they must also have 
diverse sources of support so thai they are not beholden to 
any single interest or influence. To maintain significant 
inner direction, the college or university must be trusted by 
Ihe society; to maintain this trust while preserving 
academic integrity is one of the continuing problems of 
higher educational policy and administration. 

Knowledge and Learning as Values in Their Own Right 

In most contemporary discussions, higher education is 
viewed as a means to ulterior ends. However, learning on 
the part of both students and faculty, the discovery and 
dissemination of knowledge, arlistic creativity, and the 
preservation and advancement of the culture can all be 
regarded as goods in themselves without reference to any 
specific instrumental purposes. Similarly, academic excel- 
lence can be regarded as intrinsically valuable. Moreover, if 
the experience of the past generation or two teaches us 
anything it is thai knowledge gathered for its own sake, for 
the mere value of knowing, often proves to be useful in the 
most unexpected ways. 

This goal of knowledge for its own sake argues for 
substantial unrestricted funds for higher education to be 
used as the academic community decides. Indeed, higher 
education is almost unique in our society as a place where 
learning and culture are pursued for their own sake. Our 
society should support at least one center where learning is 
cultivated in terms of its own intrinsic worth and not 
primarily as a means to ulterior objectives. 

Geographic Dispersion of Educational Resources 

Educational opportunity and resources should be 
distributed geographically so that opportunities for people, 
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and also the cultural and economic influences of strong 
institutions of higher education, are available in all parts of 
the country. Without preventive efforts, the ablest faculty, 
the best students, and the richest resources will gravitate to 
a selected few institutions in restricted areas of the country. 
Adequate geographic dispersion calls for federal aid to 
poorer and sparsely-settled areas, and for institutional 
control of significant amounts of student aid funds. 

Diversify and Progressiveness 

A goal of higher education is to achieve a diversity of 
institutions, programs, modes of instruction, and points of 
view to accommodate students of varied interests and 
objectives. A related goal is to encourage diversity in the 
sponsorship of institutions including federal government, 
state and local government, private non-profit organiza- 
tions, and private business corporations. In a time of rapid 
relative growth of the public sector of higher education and 
increasing political influence over the public institutions, 
the survival and prosperity of the private sector is of special 
significance. The private sector, moreover, contributes 
much in leadership and quality to the higher educational 
system. 

The goal of diversity calls for either of two policies; 
(1) supplemental aid to students who atlend private insti- 
tutions in order to compensate for the relatively high tui- 
tions in the private sector or (2) raising tuitions in public 
institutions and thus narrowing the tuition gap. 

Diversity and progressiveness also calls for substan- 
tial categorical aid for new institutions and new projects. A 
danger in such categorical aid is that it will encourage 
phony or ill-advised innovation. Another risk is that gov- 
ernment and foundations will give lemporary support for 
Ihc novel without properly encouraging the strengthening 
and improvement of good features of the traditional. Solid 
change is an evolutionary process, not keeping up wilh an 
endless succession of fads and gimmicks. 

Conclusions 

The principal conclusion is that various goals, when 
viewed separately, call for different modes of finance. Can 
one consolidate the various strands of the argument into a 
coherent system of finance? The answer is yes, but because 
of differences of outlook and priorities, one man's coher- 
ence can be another man's insanity. I shall try to present 
the conclusions I have reached about the financial pattern 
that derives from the fifteen goals. 

Colleges and universities should have substantial 
unrestricted funds, preferably from diverse sources, in pur- 
suit of the goals of academic freedom, the advancement of 
knowledge and culture for its own sake, the promotion of 
national economic growth, the solution of social problems, 
and the cultivation of citizenship. These unrestricted funds 
O 
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might properly come in part from the federal government 
— especially for promotion of national economic growth 
and solution of social problems. 

Federal and state governments should be able to 
influence — without dominating — higher education by 
means of categorical grants for goals such as economic 
growth, solution of social problems, geographic dispersion 
of educational resources, diversity and progressiveness of 
higher education, and general responsiveness of higher 
education to social needs. 

A system of finance based on low tuitions coupled 
with student aid emphasizing grants would contribute 
toward the goals of access, citizenship education, equity, 
and tempering inequality of income (in the long run). 

On the other hand, a system of finance based on 
high tuitions coupled with student aid in the form of either 
grants or loans (with student aid independent of institu- 
tions) would work toward student freedom, diversity and 
progressiveness, and improved income distribution in the 
short run. If this system were extended so that colleges cr 
universities were market-oriented in all or most of their 
activities, goals such as responsiveness, efficiency, and 
minimum scope of government would be favored. 

To meet the goal of diversity and progressiveness, 
special provision would be needed to improve the 
competitiveness of the private scclor, either: (1) tuition 
equalization in the form of special grants to students to 
meet the extra tuitions of private institutions, or (2) higher 
tuitions in public institutions, i favor the first of these two, 
because J believe on other grounds thai tuitions in public 
institutions should be kept moderate. 

To meet the 30a! of geographic dispersion of educa- 
tional resources, some substantial part of student aid 
should be under the control of institutions. 

In my judgment, no simple solution to the problem 
of financing higher education, based on only A few goals 
and glossing over others, will serve. The ekily tenable 
solution for the finance of institutions is a blend of unres- 
tricted funds and categorical grants from diverse public and 
private sources, moderate tuitions, and reasonable fees for 
non-instructional services; the wisest solution for the 
finance of low-income students is a combination of grants 
and loans, with grants providing bare minima to assure 
opportunity and loans used as supplemental sources to 
assure flexibility. Such loans might be long-term and have 
income contingent features. 

My assessment of the goals leads me to question 
current tendencies toward converting colleges and univer- 
sities into market-oriented institutions without strong inner 
direction, and equally to question current tendencies to 
finance low income students primarily through loans. The 
need is for judicious balancing of many goals and 
balancing the financial devices appropriate to these goals. 
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The system resulting from such balancing will never be 
tidy or simple. It will never achieve any objective fully* But 
neither will it destroy or handicap an educational system 
that has achieved first rank in the wortd in excellence and 
a! the same time has extended higher educational 
opportunity more widely than ever before in world history. 

The same conclusion was reached by Marion B. 
Folsum, a distinguished businessman, former Secretary of 
Health, Education, and Welfare, and a long-time leader of 
CED. He said: 1 

The financial support of higher education is a 
patchwork quill. This support is drawn from vir- 
tually every known source . . . This patchwork quilt 



... is no jumbfu of confusion. Instead, it is a signifi- 
cantly complete list of the groups that form the broad 
base of support for higher education in our society 
, . . If it is true that "he who pays the piper calls (he 
tunc," the integrity of higher learning is ensured by 
the fact that no one group can "call the tune." This 
broad base of support ensures that our system will re- 
main free of a single, limiting educational creed. And 
this, in a sense, is the genius of American education 
— that there is no single interest no one creed or 
dogma, that might stifle the freedom and independ- 
ence we as people cherish. 



This address was aided by a grant to Howard Howcn from the Committee for Economic Development, The content will also be pub- 
lished by the CED as "The goals of Higher Education and Their Financial Implications" (forthcoming). It is printed here with permission from 
the Committee for Economic Development, 

1 Marion B, Folsom, "Who Should Pay for American Higher Education?" in Economics of Higher Education, Sclma [. Mushkin (ed.) U.S. 
Department of Health, Education, and Welfare, OE 50027 Bulletin 1962 Number S. Washington: U.S. Government Printing Office, 1962. p. 195. 
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THE CHOICE OF A FUTURE 



Joseph T. Sutton, University of Alabama 



In following Robert Clark at the podium, my first 
impulse is to say, "Though I speak with the tongues of men 
and angels and have all knowledge so as to underst; nd all 
mysteries, because I have to follow Robert Clark, I'm 
dead/' And Don, 1 appreciate what you said about me. I 
was wondering what you would find to say. Actually. I was 
hoping that you would point out that my most significant 
attribute is that I'm so levelheaded. As you know in 
Alabama we have an operational definition of levelheaded- 
ness: that's a man whose tobacco juice runs evenly from 
both corners of his moulh. 

An appropriate presidential address before the Asso- 
ciation for Institutional Research should contribute new 
insights into the role and function of the profession so as to 
inspire the members with a clearer sense of direction into 
the future. I had aspirations lo deliver such an oration — 
one that would not only vindicate the judgment of the 
members who entrusted me with this high office, but that 
would also enshrine forever the memory of this time and 
place in the hearts of my listeners. Having set this goal, I 
prepared carefully. 

My homework included a re-reading of the papers 
and addresses of all former presidents and such institu- 
tional saints as Dresscl, Lins, Russell, and Brumbaugh. At 
that point, 1 understood the feelings of Charlie Brown on 
the occasion when Lucy asked if he and Linus could 
describe what they saw in the piles of cumulus clouds over- 
head. Linus reported that he saw the stoning of Stephen, 
Michelangelo in the Sistine Chapel, and Napoleon at 
Waterloo. Then Charlie Brown said, "I was going to say I 
saw a goosey and a ducky, but 1 have changed my mind." 

I also was required to make some change — at least, 
insofar as the title of this address was concerned. 
Originally, it was called "An Inquiry into the Epistomo- 
logical Foundations of Institutional Research with Special 
Reference to the Resolution of Certain Teleotogical 
Antinomies." However, the girls in Don Lelong's office 
would not print that in the program. Then I proposed 
"Institutional Research and the Three B's — Books, 
Buildings, and Bodies — in the Garden of Learning. Will 
they live happily ever after? '. At that point, they suggested 
that my speech should be called "How to Meet Yesterday's 
Imperatives Tomorrow." Regardless of the title, I'm going to 



talk about you and me, institutional research, and the 
Association for Institutional Research. 

Can Institutional Research Make a Difference? 

A salient fact about colleges and universities today is 
that the expectations they have held for the future have 
been grievously wounded. In the decades of the 60's and 
70's. we, in higher education, dreamed no little dreams. It 
was the best of years for physical planners. Community 
colleges sprang up over the country. Junior colleges and 
extension centers became senior colleges, and senior 
colleges became universities. Degree programs proliferated. 
Research flourished. 

This pyramid of higher education has now begun to 
erode near the top and on the windward side. The presti- 
gious institutions and the privately supported colleges have 
been the more significantly affected, and nearly all institu- 
tions are sobered at their own prospects. 

A second observation, made eloquently by Dr. 
Caruthers last night, and by Lyman Glenny at the 1971 
Fjrum in Denver, is that those who have traditionally been 
rcsponsbile for the leadership of colleges and universities 
are less and less able to exercise control over them. Harlan 
Cleveland, in his recent book, The Future Executive, 
contends that organizations arc losing their hicrarchiat 
forms and that the organizations of the future "will be 
interlaced webs of tension in which control is loose, power 
diffused, and centers of decision plural." Surely, this is an 
apt description of the current situation in higher education 
governance. 

Educational organizations with thwarted aspirations, 
increasing complexity, and with little control would appear 
to be less than ideal places to accomplish anything, but 
institutional research offices are found in such places — or 
so I'm told. Indeed, some institutions have established 
offices of institutional research because they have found 
themselves facing new and difficult problems. Perhaps the 
promise of institutional research is brighter* the darker the 
institutional prospect. 

The question for us today is: can institutional 
research make a difference? Institutional research will not 
be spared from the general muster to accountability. My 
judgment is that we can demonstrate that institutional 
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research is making a significant impact in understanding 
University management particularly fiscal management. 
However, the larger accountability of institutions to society 
is neither financial nor managerial accountability. That is 
the primary role of comptroUers, business officers, auditors, 
and examiners of accounts. 

The institutions we serve arc primarily accountable 
for the effectiveness of their educational programs. It 
follows that the activities of the faculty, in their aggregate, 
comprise the prime functions of the college or university in 
accomplishing this purpose. Increasingly, I fear, institu- 
tional research officers are seen by faculty as the resident 
Satanic apostle, emphasizing quantities rather than quali- 
ties, and efficiency rather than effectiveness. The existence 
of institutional research on some campuses has become an 
additional frustration to faculties. 

The institutional research role is applicable to the 
entire university and its constituent programs. The Con- 
stitution of the Association reads that the major purposes of 
the Association shall be "to benefit, assist, and advance re- 
search leading to improved understanding, planning, and 
operation of institutions of higher education." 

An institutional research officer should entertain the 
hypothesis thai he or she can, by employing the tools and 
skills of his/her profession in a professionally competent 
Way, contribute to the effectiveness of the faculty. In 
complex systems, control and direction are difficult to exer- 
cise. But institutional research officers understand systems, 
and it is this understanding that faculties need. 

To assist in understanding the problem, consider for a 
moment the evolution of biological and social systems. The 
primitive unicellular protozoon, in its relatively simple or- 
ganization and structure, performed all the essential bio- 
logical functions — assimilating food, eleminating wastes, 
moving about, sensing its environment, reproducing, etc. 
As multicellular forms appeared, so did cellular speciali- 
zation in function and differentiation in structure. In 
specializing, cells were able to do a more efficient job — of 
digestion, or movement or coordination — but in the process 
these specialized cells lost some ability to do other func- 
tions and thereby became increasingly dependent upon the 
multicellular system of which they were a part. 

Similarly, primitive man as a social organism had a very 
generalized social function in the family or tribal structure, 
but gradually roles and skills began to differentiate. The 
social function of education eventually became a special- 
ized role for some members of the culture. In turn, educa- 
tional administration was differentiated from leaching, and 
in recent years, l.R. has become differentiated from educa- 
tional administration and research. The first institutional 
research was apparently done by college presidents. Some 
of them still do LR. as a not yet fully specialized and dif- 
ferentiated function. 

are several points to this illustration. First, we give 
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up part of our freedom to make individual choices of a 
future when we become members of a corporate group, 
society, tribe, college, or university. Interdependency with 
its consequenl loss of control by the individual was, and is, 
the price that is paid for more efficient production and 
higher living standards for the group. 

Another indication from this brief look at the evolu- 
tion of systems is that not all institutions have evolved to 
the same level of complexity and specialization. Some insti- 
tutional research officers do give major attention to the 
educational programs of their institutions. If others of us 
find ourselves becoming specialized in management, it is 
time for another mitosis to occur so that the research func- 
tion as it applies to effectiveness of teaching will not be 
lost. 

Reviewing Progress 

The higher purpose of institutional research is then 
to enable our institutions to continually review {heir 
progress, to project their many possible futures, and to 
select among these, those that arc both desirable and real- 
istic. There are many ways in which institutional research 
can fulfill this purpose. 

Principally, I am speaking about education of the 
faculty to the corporate reality of higher education as a 
system. We recognize that we all retain significant emo- 
tional machinery that evolved in conditions where survival 
was at stake, and that this machinery responds to personal 
threat with an overpowering need to do something about it. 
This need has many of us running off in several directions 
at once. If there is to be an antidote to these individual 
"solutions" to higher education problems, institutional re- 
search must contribute to effective coordination and com- 
munication of the corporate purposes and goals of the insti- 
tution and the means whereby the institution achieves 
these. 1 think this understanding is needed most severely 
today by the faculty. If, in our own sense of threat, we 
forget the threats perceived by others, especially the facul- 
ty, we have forgotten the unique role of institutional re- 
search in the institutional system. 

The role of the Association has emerged from the 
role of institutional research in the institution. We need to 
come together on occasions such as this to learn from one 
another. But we also need to be self-conscious about the 
Association so that we can corporately influence the future 
of our profession and thereby our own. We have evolved to 
a significant level of complexity as an association and need 
to consider whether differentiation and specialization of 
functions should occur, We need more effective feedback 
mechanisms so we can develop a better information system 
on our members and their activities. We need to share this 
information among ourselves and consider its implications. 
What are the implications to us all, for example, that only 
about a third of our members give full time to institutional 
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research activities, or lhat only about 20% of our members ning and budgeting purposes? 

come from junior and community colleges? How is the rote The cobter's child goes unshod. Can the Association 

of the Annual Forum changing, and how should it change? contribute lo the number of possible career futures from 

Should the Association develop a P.P.B.S. for its own plan- which we as professionals may elect our own? 
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HIGHER EDUCATION UNDER STEADY-STATE CONDITIONS 



Allan M Career, Carnegie Commission on Higher Education 



If 1 had known there were so many people here with 
long memories, 1 would nol have brought the same speech 1 
used in 1905. Actually 1 remember that event very well. The 
Three Village Inn in Stony Brook isn't up to the standards 
of the Hotel Vancouver. It has lots of old world charm, but 
the thing 1 remember was that the room was very dark. I am 
terribly near-sighted and can hardly sec my notes on the 
podium anyway, and Ihcy had a standing lamp over there 
with a 40-watt bulb in it. 1 spent the evening standing 
under the lamp, getting someone else to turn pages for me. I 
did not have time to write this one, so I will not have as 
much trouble with turning pages. 

The other thing that happened was that 1 had not 
been to Stony Brook before. That's why 1 accepted that 
invitation. 1 fell in love with it and six months later I 
bought a summer house there, and for many years enjoyed 
going out and looking over their shoulder. I'd never been (o 
Vancouver before until this invitation came, so I'm going to 
check with Bob Clark later about real estate in this city. 

It is true that 1 tried out that evening in 1965 for the 
first time publically, the faculty supply and demand projec- 
tions that 1 had been working on. 1 remember the last sen- 
tence of thai speech. It was. "my advice to young faculty 
members or graduate students is that 1970 will be a good 
year by which to have achieved tenure." Both AIR and 1 
have aged a little bit since that lime, but that advice was 
still good. 1 think. 1 don't quite understand why 1 don't 
practice what 1 preach. Just two months ago I resigned my 
tenured professorship at NYU in Economics. It was after 
that meeting that some member of this Association sent me 
a little note with a quote from Sir Thomas Brown which 
read; 

Amuse not thyself about the riddles of future 
things. Study prophecies when they become his- 
tories. Eye well things past and present and let 
conjectural sagacities suffice for things to come. 
There arc times when 1 wish I had listened to Sir 
Thomas Brown's advice. But I think I'm the kind of 
frustrated institutional researcher myself. For the belter 
part of len years it was a kind of advocation — something 
that one did on nights and weekends. This year has been a 
kind of plcasurably traumatic experience for me for, partly 
on Ihn Guggenheim Research Fellowship and partly by the 
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Carnegie Commission on Higher Education, I now do from 
8:00 a m. to 5:00 p.m. what 1 used to do by lamplight. 1 hope 
my back cast friends notice that on the west coast at 8 a.m. 
to 5 p.m. we work a 40-hour week not including lunch. 1 
find in switching from night to day time, that research on 
higher education is rather different when you sec it by day- 
light. There arc certainly a lot more distractions, you don't 
squint quite as much, and when you get stymied on some- 
thing you can always pick up the telephone and find an 
answer. You can't do that at one o'clock in the morning. 

But even ominous projections aren't quite so depres- 
sing when you sec them in the daylight. Last year I 
attended on OECD conference in Paris on university 
management and one of our French colleagues who was 
Rector of one of the universities was making a speech. They 
had simultaneous translations and suddenly the English- 
speaking community broke up with a roar of laughter 
which disrupted the meeting, We had to explain to the 
speaker what the difficulty was. The French translation 
into English came through as he was speaking about insti- 
tutional research and budget analysis as "some people like 
to study futures, other people like to contemplate bchinds." 
1 want to suggest that that can be a kind of useful distin- 
ction. It's whether one's outlook is oriented to the past or to 
the future, and ! would pose that an applied science such 
as Institutional Research, if it is really going to be effective, 
is of little value if it concentrates only on the past; if it docs 
not provide some guidelines or guidance for the future. The 
corollary, of course, is, and my own experience well illus- 
trates this, that no futurist is worth much if he isn't familiar 
with the past and docs not try to test his projections of the 
future against the past experience. 

My original battles and strong criticisms ot the 
National Education Association's studies on the Office of 
Education in the mid 19G0's were largely because they built 
models of the future that only a cursory analysis should 
have indicated would not predict the present by glancing 
back to the antecedent. 1 have made a lot of errors in 
projecting in looking at labor markets in the supply and 
demand relationships, and 1 am embarrassed by a few 
things of mine in print, but it has almost always occurred 
because 1 have trusted the past too much, not too little. But 
in today's uncertain world 1 think all of us arc looking more 
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and more searchingly inlo tho future? and w«. arc having to 
speculate much more upon alternative courses of action. 
Tho presidents of universities and their trustees are 
increasingly asking us what effect there is going to be on 
tho age. rank and tenure distribution depending on 
different faculty personnel policies; what the effect is going 
to be on enrollments of different tuition and scholarship 
policies: what is the voucher plan going to do to us; would 
the Yale contingent loan program help or hurt our situa- 
tion: ho^jfis Ihe changing ratio of men and women students 
going to affect curriculum, use of facilities, etc. So I think 
that all of us are being forced to look more into the future 
and to speculate more on alternatives. As I look to the 
future today. I think everything seems much murkier than it 
did five years ago. 

Let me cite a few areas where I think the past is no 
longer a reliable prologue to the future. 

College Enrolments 

The obvious case is that of what's happening lo 
college enrolments. As pessimistic as some critics felt my 
projections of faculty needs were when ! did them in the 
mid 1960 s, the situation now seems likely to be even worse 
than when one first looked at it. Most of you are familiar 
with parts of this evidence Let me just quickly run through 
a few things that 1 think made it much more difficult today 
to look ahead. The demographic factor: the birthrates 
continue to decline in a rather frightening way and no one 
knows when the situation is going to stabilize. Last winter 
for the first time in history in the United States we dropped 
below the zero population growth fertility rate, When 1 
started making these projections in 1964 and 1965, we were 
all forecasting the future based on Bureau of Census, Series 
B' population projections which indicated that by the end 
of this century we would have an 18-21 age group of almost 
24 million people. In 1969, when 1 went back and look a 
new look at it, we were talking about Series *D* projections, 
and instead of 24 million, it was only 19-1/2 million. In 
January, 1972, in another piece that I did, I had to shift to 
Series 'E' projections which looked as though they were 
going to be a little over 17 million college-age population by 
the end of the century, By June, 1972, when 1 reached the 
Carnegie Commission, Gus Hagstrum has done the projec- 
tions there, and I went through again and we dropped 
down to something about 7 or 8 percent below Series 'E'. 
And just two months ago the Census Bureau finally 
brought out a new series T* which now predicts for the end 
of the century an 18-21 age group of 15-1/2 million. That's 
exactly the number we have in 1973. That's a very different 
kind of future than it looked as though we could 
contemplate 7 or 8 years ago. So over the next few years, up 
to about 1980, the college age group is going to grow by 
about 1-1/3 million in the States. By 1988, however, it will 



have dropped 2,9 million down to about 14 million persons. 
1 noticed in the New York Times on Tuesday that Arthur 
Campbell in the Population Research Center of N1H was 
quoted as predicting a turn-around in fertility rates very 
shortly, believing that the dramatic change in the last three 
years is largely the result of postponing having children 
rather than not having them at all, but that's no help to us 
before 1995. So certainly as one looks to the demographic 
factors, things look much grimmer for those of us who are 
in the business of selling educational services that it did 
when we looked at it in the middle or late 1960's. 

High School Completions 

A second factor equally important is what's happen- 
ing to high school completions. All of my enrolment projec- 
tions and most others that 1 have seen recently are based on 
the assumption that there is going to be a continuing 
increase in the proportion of the age group that graduates 
from high school. In my projections I have built in a 1% 
point per year annual rise from about 78% at the present 
time up to about 90% in the early 1980V Now it appears 
from recent figures that in 1970 there was only a .2 of 1% 
increase and in 1971 high school graduates dropped about 
1% . so the pool of potential students is already about 4% 
below the estimates I and Ihe Office of Education and 
others made only three years ago. I have not the foggiest 
idea of where we are going in high school experience: 
everyone seems to be puzzled by this reversal. 

The third factor is what's happening to college 
enrolment rates, and again two months ago, the Census 
Bureau came out with a report which I am sure all of you 
saw. that the proportion of 18-19-year-old males In college 
dropped from 44% in 1969 to 37,6% in 1972. For the 20-21- 
year-olds, it went from 44.7% down to 36% . In the case of 
women the 18-19-year-olds remained constant, 20-21-year- 
olds went up by about one percentage point. But at least the 
proportion of Ihe age group going to college in 1972 is now 
about 4 percentage points below what it was in 1969. I had 
assumed in my projections, it would rise about 2-1/2% in 
that period. The O.E, projections have built in about 3% 
rise, so we are far off the target in college enrolments. 

The fourth factor, somewhat related, or at least addi- 
tional evidence, that while the percentage in college may 
have dropped, the question is what's happening to absolute 
numbers. The Office of Education this year has done a 
hand tally of Fall 1972 enrolments and now we find that 
first-time enrolment in degree credit courses was down 
1.4% for the United States in fall 1972 from the year before. 
There was a healthy increase in non-degree enrolments, but 
not enough to really make up for that. First-year graduate 
enrolments in fall 1972 increased by only .06%. They had 
been going up 5 to 10% a year. So looking towards the next 
5 to 10 years, one could, on the basis of these somewhat 
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shaky factors of the last two or three years, if you tried to 
contemplate the worst, the high school graduates and 
college attendance rates would plateau out at their present 
levels and the graduate enrolments would stabilize — if all 
of that happened, then all we could look forward to is 
about an 0% increase in enrolments during the rest of the 
1970 s and then, of course, a contraction fairly sharply in 
the 1980's. If you compare this wilh the Office of Education 
projections that full-time equivalent cnrolmcn! will go up 
by, I think, it's 51% in the 1970 s, or even the Carnegie 
Commission assumptions that would rise by between 40 
and 45 percent, you can sec that one can be very seriously 
shaken by this. 

How much substance one should give to the events 
of 1970 to 1972 1 don't know. The change in the draft status 
in Vietnam and temporary recession, unemployment, these 
may all just be very temporary things, but I think most of 
those who arc watching these barometers rather carefully 
arc rather seriously shaken by it. Anyway, if in fact enrol- 
ments only went up by 8 to 10% over the rest of this decade 
even my most pessimistic projections of the demand for 
college faculty would look unrecognizably rosy by compari- 
son with the facts. 

Let me look very briefly at the supply side of the 
academic labor market. Again, the rate of growth in Ph.D. 
output has been declining fairly sharply. The first-year 
graduate enrolments as a percentage of baccalaureate 
degrees granted in the proceeding year actually peaked for 
men in 1966 and has dropped about 20% since then. For 
women that percentage of B.A.'s going on to graduate work 
peaked in 1968 and has dropped about 6% since then. If 
you also look at the ratio of Ph.D/s granted to first-year, 
first-lime enrolments in graduate school, on the average 
about 'five years earlier, you find that factor peaked for men 
about 1970 and is now dropping fairly substantially. For 
women is seems to have stabilized the last two or three 
years — that's in effect a kind of completion rate of 
doctoral studies. Our latest estimates at the Carnegie 
Commission arc that the 1972 Ph.D.'s. who numbered about 
34.000. that the number will grow the somewhere around 42 
or 43 thousand by 1980. That compares with the last 
published O.E. projections of something like 68.700 so 
there is some sharp adjustment going on on the supply side 
of the market, too. In some fields the reversals arc very 
dramatic. Physics is probably the best documented. In the 
case of physics the percentage of freshmen who major in 
physics in college has dropped from 1.8% of all freshmen 
in 1960 to .6% in 1972. So their share of the market has 
declined down only 1/3 of what it was 12 years ago. The 
first-year graduate students, in comparison with a number 
of junior majors two years before — that is morc-or-lcss the 
percentage that go on to do graduate work — has dropped 
from a high of 46% in the late 60 s now down to 30% , and 



the number of Ph.D.'s granted in physics, since there arc 
enough time lags built into the system, hit its high p<rnt 
this last June at about 1,600. It looks as though it is going to 
be down to only slightly over 800 by about 1977 or '78. So 
there arc some fields that arc adjusting very rapidly to the 
change in job market conditions. There arc other fields 
where it seems to be happening in the reverse fashion, The 
most perverse usually (urns out to be in the field of educa- 
tion where for some strange reason 1 guess the tougher the 
job market gets* the more important it seems to go on to get 
one more degree to Uy and protect your position in your 
career. 

Employment of Ph.D.'s 

But strange things have been happening In the 
employment market of Ph.D.'s. So strange, but again 
although I have spent a part of this year trying to look at it, 
I don't know how to decipher it. Over the last five years the 
number of Ph.D.'s taking academic teaching positions, even 
during this period when we talked about the tough job 
markets, the number taking teaching positions in higher 
education has gone up forty percent. Two factors seem to 
account for this. 

One is an increase in the percentage of new faculty 
hired who already have the Ph.D. Institutions arc hiring 
many fewer who have lesser terminal degrees. The second 
factor is that there is much more filtering down going on as 
Ph.D.'s now turn up much more frequently in institutions 
of somewhat lesser repute. There arc several interesting 
studies that have been done by John Nyland that arc very 
revealing on this. Comparing 1968 to 1971. he did a study 
using the- infamous Carter ratings trying to sec what 
proportion of Ph.D.'s in various fields took their first 
teaching appointment in an institution that was of equal or 
of higher quality than the one from which they got their 
Ph.D. So if you got your degree from Harvard you had to be 
hired by Harvard or you didn't fall into that figure. In the 
field of economics in 1968. 20% of the new Ph.D.'s moved 
on to teaching jobs in institutions as good as the ones 
where they got their degree: 1971 it was down to 6% . In 
mathematics it dropped from 29% to 9%: in geography 
from 25% to 4% , and the overall figures were 19% and 8% . 
So there is a very sharp change in the pattern of types of 
jobs that new Ph.D.'s arc taking when they finish their 
graduate training. Obviously there is a bumping process 
going on and Ph.D.'s arc bumping people with lesser 
degrees or masters degrees or whatever in some of the state 
colleges and junior colleges. 

Even more puzzling to me arc the reports of the Na- 
tional Research Council that the number of new Ph.D.'s 
taking appointments in the academic sector as post-docs 
has actually gone up by 60% in the last five years. In this 
same period the number of post-doctoral fellowships and 
Irainccship awards has declined markedly, and yet 
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somehow these people lurn up as post-docs in the major 
universities. What appears to be happening is a kind of 
holding pattern that developed in a lot of the major univer- 
sities and they tend increasingly, now, to be hanging on to 
their new Ph.D.s if they don't find other attractive employ- 
ment immediately, and plugging them into ongoing 
research jobs in their own institution. In this way, they arc 
sort of bumping what used to be the graduate student R.A, 
and to some extent, even the teaching assistants. I find at 
Berkley, in some fields, they are even splitting post-doctoral 
appointments now. In Particle Physics most of the post- 
docs are offered 50% appointments at $5500 or whatever 
instead of full time at $11,000, so increasingly (here is a 
kind of holding pattern that has developed over the last two 
or three years. But I think it's fairly obvious that this can 
only be a temporary phenomena. You can t go on enlarging 
that reservoir continually; you can do it for a short period of 
time largely at the expense of support of graduate students 
in the department. My personal belief is that the academic 
labor market situation is going to get slowly but progres- 
sively worse in most fields — less so in those which are 
quickly adjusted such as physics — and the problem would 
be less acute obviously in those fields where there is a fair 
amount of traditional employment in government and 
industry or in the scientific fields, where I think employ- 
ment prospects have to rise again in the next several years. 
The really gloomy period, however, has never seemod to 
me to be the 1970*s; it's always looked to be in the 1980*s. 
So in one sense perhaps we should be thankful that the 
budget constraints of the early 1970 s have given us a lot of 
forewarning and that at least some adjustments now arc 
taking place within the system. 

Steady-state Conditions 

This, looking from another point of view, poses a 
kind of institutional problem that I suspect many of you arc 
also wrestling with and that is. how do we live in a world 
that's more akin to that of a stationary state without getting 
top-heavy in our faculty age and rank distribution. We have 
been playing with building models of the Carnegie 
Commission, faculty-flow models, trying to sec what was 
going to happen if nothing else changes in the situation, but 
these enrolment adjustments that we can see coming and 
what's going to happen to faculty hiring and the faculty age 
and rank distribution. In 1970, 51% of college teachers were 
under the age of 40 and as we follow this model through, 
assuming everything else remains the same, the relative 
salaries and retirements, that figure will drop from 51% to 
18% by 1990. If we have problems now with generation gap 
you can sec what it will be 20 years from now, In fact, the 
biggest shock of my life is finding out that 78-1/2% of all 
college teachers are younger than 1 am. That did more to 
make mo feci ancient than anything 1 have ever done. 
Because there are so few faculty members, relatively* at the 



present time who are over age 50. it moans that the impact 
of expansion of the last 10 and the next few years. me?,ns 
that the combined mortality and retirement rates of faculty, 
if there are no changes in retirement policies, which added 
up to about 1,6% of the faculty either died or retired in 1970 
— that factor actually is going to drop (o about 1.2% in 
1985. So there is very little relief one can see until one gets 
almost to the turn of the century in terms of much higher 
retirement rates. I started out about two years ago when I 
was getting alarmed by this to talk about lowering the 
common age retirement for faculty members. In fact. I think 
my last act at New York University before leaving was to 
drop the retirement age from 68 down to 65. Then I got out 
of town the next week! I have now come to the conclusion 
that really doesn't have much impact on the total system. It 
may help the individual institution but very little relief 
would occur from merely lowering the retirement age. 
Obviously that drop from 51% to 18% of the faculty that 
are under age 40 is not going to work that way: the market 
will make some adjustments. There are some changes 
taking place in tenure policy, some changes in retirement 
policy, there are going to be some adjustments in relative 
salaries between academic and non-academic employment 
and the situation is going to be a little fluid. But it's 
interesting to try to built your first model and sec what 
would happen if nothing else changed. Now we arc going 
back, and trying to sec what happens if you build in 
various assumptions on these adjustments. 

Let me turn briefly to two other areas where the past 
provides very few clues for the future. I believe that in the 
last several years there arc many signs indicating that 
public policy is beginning to shift around more and more to 
the view that one should support students rather than just 
institutions. The imposition of tuition at the University of 
California in 1970 may have signalled the beginning of this. 
The higher education amendments in 1972, 1 think, if one 
analyzes them carefully, arc a clear indication that Federal 
policy is shifting in this direction and when Bob Kibbee 
throws in the towel, then we will really know it's a trend. 
Every year thn city university is threatened with moving to 
a tuition fee; they have not done so yet. The forthcoming 
Carnegie Commission report, due out at the end of /une, is 
going to urge a narrowing of the tuition gap over the next 
decade, the gap between public and private institutions 
plus a substantial increase in financial aids to students. I 
gather there is a Committee on Economic Development 
report that's going to be out very shortly with somewhat 
similar types of recommendations and there are many stale 
reports like the Governor's task force in New York that 
have come up with recommendations of that sort. 
Increasingly, it seems to me this is becoming more and 
more the fairly common popular view as the direction in 
which we should go. It is seen as a way to provide adequate 
resources to make universal access to higher education a 
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rcalily while at the same time trying to preserve? diversity of 
institutions. The California State Scholarship Commission 
in its study of how college students pay for the financing of 
higher education done in 1972 is indicative in this regard. 
We at the Carnegie Commission have combined some of 
the California data with our estimates of institutional 
subsidies and have come up with the foilowing estimates, 

In the public sector — thji's taking the two-your 
and four-year colleges all together — the students and 
families in the highest income group (that's $18,000 and 
over in the State Scholarship Commission study), students 
and families in that highest income group contributed only 
51% of the total monetary outlay as we have defined it, 
which is all of the institutional costs of education, the sub* 
sistence cost of the student minus whatever student aid 
they had. So 51% was contributed from those in the highest 
income group. Students and families in the lowest income 
group contributed 35%. In the private sector, those per- 
centages are 54% and 31% . Bit there seems to be increasing 
pressure, 1 think, to try to create somewhat greater equity 
and many people argue that there ought to be greater dis- 
parity between them. Perhaps those in the highest group 
ought to move to 65 or 75% contribution and those in the 
lowest income group, if we are really going to do away with 
the financial obstacles to attendance, ought to drop down to 
15% or 10%. But I believe there is increasing opinion that 
public subsidies need to be redirected to be of greater assis- 
tance to the low and lower middle groups. 1 think (hat is 
going to make a considerable change in the 1970 s on many 
of us. 

A Learning Society 

Finally, let me (urn to one other area which is 
rapidly becoming part of the public consciousness and 
could have a marked impact. Over the past decade we have 
seen a change in nomenclature for education to persons 
beyond the normal college age. We have spoken of adult 
education, which became continuing education, and now 
Increasingly you hear comments about recurrent educa- 
tion, the life-time learning society, etc. J think it's more 
than just words. The new civil rights emphasis in this 
country, I think, has given us somewhat greater concern for 
adults who missed out when they were 18 to 21 and never 
did get any advantage of post -secondary education and 
most particularly so when you look at studies like that of 
Bob Hartman at the Biuokings Institution that indicates that 
40% of the public subsidies that go to higher education are 
paid for in taxes by people who are non-attenders — that 
is. who did not get any benefit directly from it. Similarly* 
somewhat in the civil rights vein, the increasing re-entry of 
older women to the labor force, many of them wanting to 



go back and get refresher courses or to complete education. 
In addition to that, the rising problems of technological 
obsolcscnce is making us more aware of the need for 
retraining at various times in one's life. The manpower 
training problems that have emerged because of the rise 
and fall of industries like aerospace, the increasing practice 
of young people of stopping out in higher education and 
then at 25 or 30 wanting to come back to complete — all of 
these things arc contributing to a new awareness and a new 
kind of demand for higher education on the part of adults. 
Last year the OECD held a very interesting conference on 
new patterns of life in adult years. The chief argument was 
that study, work, and leisure all ought to be seen as part of 
a continuum and that separating out financing retirements 
one way, and education in another way, didn't make much 
sense. The recommendations for the OECD member 
countries were that they ought to explore moving to some 
kind of common social insurance program which would 
recognize that there are Irade-offs between lifetime educa- 
tion, periods of leisure, adjustments in retirement age, etc. 
The International Labour Organization is holding a big 
conference in Geneva this summer on the subject of paid 
educational leaves. The new programs introduced within 
the last ttvo years in Fiance and West Germany have 
suddenly stimulated a great deal of interest. There is rising 
interest among the trade unions in this country and it's 
quite possible that this will bring more and more 
awareness and more and more pressures for doing 
something to help finance other than traditional 18-21 
education. The Commission on Non-traditional Studies, the 
report of the new Commission on Continuing Education 
that Father Hesburg chaired, the report due in August or 
September by the Carnegie Commission, all of these things 
are adding much more interest and much more concern 
with the factor. 

The likely next major development, I think, is 
devising some type of contributory plan to finance adult 
education. If so, it could revolutionize the educational 
structure of higher education. At the present time only 
about 25% of these activities take place in what we think of 
as colleges or universities. A lot of it is out in civic 
organizations and proprietary schools, etc. 

I have catalogued a number of areas which many of 
you either now do or will shortly deal with in one respect 
or another. They are all areas in which guidelines seem 
unclear at the present time and where extrapolation is 
inadequate. It makes the Job more challenging if more 
difficult. The only thing I think that we know for certain 
today, and perhaps we should be thankful for this one 
thing, is that famous punch line of the comedian Mori Sahl, 
"the future lies ahead.*' 
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For those of us who have watched with alarm and 
bewilderment the shifting breezes of Federal involvemenl 
in education during (he past decade, the juxtaposition of 
the words pin ning and public policy in the same sentence 
approximates a contradiction in terms. Ye* both public 
interest and the public investment in higher education have 
been growing rapidly, facts which by lliuiuselvcs force us 
to deal serious! with this topic. 

PredictL g public policy as it relates to or affects 
higher education is not a pursuit which many educators 
have mastered, in fact it is not something to which many of 
us have given much thought. But since we must think about 
it now and in the future it behooves us to do so in some 
structured way and hopefully with as much information 
and analyses as we can muster. 

What I intend to say on this topic today is not 
intended to provide you with either a method or a model 
with which to approach this task. Rather I shall attempt to 
demonstrate the influence of public policy jn four broad 
areas of institutional concern and to suggest how they will 
affect radically the operation of colleges and universities in 
the future. Much of what 1 shall refer to could have been 
predicted by people assigned to systematically scan the 
political horizons even though my own awareness of them I 
readily attribute to hindsight rather than foresight. 

Given the importance of public policy to the 
operation of colleges and universities in the future {which I 
hope to demonstrate) the syllogism is easily constructed by 
which predicting public policy becomes essential to sound 
planning and thereby a matter of concern to those repre- 
sented here this morning. 

For purposes of this discussion 1 am defining public 
policy to mean any consensus of ideas and attitudes which 
has been converted into an operational principle through 
legislation, administrative regulations or court decisions, 
From this it can be readily recognized that public policy 
may be something different from popular belief and that it 
can operate at several political levels, individual states or 
even localities can establish policies that at the time are not 
widely accepted. Some of the issues I shall discuss are rot 
yet broad national policies although I am convinced that 
they soon will be. 



Let me begin by saying a few words about the 
reasons for the increasing application of public policy to 
higher education. The litany is familiar to most of you but it 
serves to provide a proper context for what follows. 

Growth 

The reason for the growing interest in higher educa- 
tion is not difficult to understand. It is a function of its size, 
its pervasiveness, and its cost. In what is realty tittle more 
than one generation, higher education has projected itself 
into the mainstream of our domestic concerns largely 
through its phenomenal ^ <vth. In the United States better 
than six out of ten higL school graduates now go on to 
college and the percentage is still growing. This means that 
today virtually every family has had some immediate ex- 
perience with college either directly or through the acti- 
vities of someone close to them. Today our colleges and 
universities enroll about 9 million students, employ nearly 
one million professionals and an almost equal number of 
non-professionals. Total expenditures for higher education 
now exceed 30 billion dollars annually, roughly two-thirds 
of which are tax dollars. Thus there is a high level of 
interest in higher education because it touches virtually 
everyone either in their personal family lives or in their 
pocketbooks — two of the most sensitive of all human 
nerve endings. 

The corollary to this growth is more subtle but in the 
long run, will be more significant and brings rne to the first 
area of public policy I wish to discuss. 

A generation ago when 1 was in college no more than 
one high school graduate out of seven went on to college 
and a much smaller percentage of those who entered high 
school graduated than do today. Thus the percentage of 
college graduates in the total cohort of young men 21 - 25 at 
the beginning of the second world war was very small, 
indeed. Except for the major professions such as law and 
medicine it was quite possible, even probable, that young 
people without a college education could make it into the 
mainstream of the nation's economic life and rise through it 
as far as (heir talents would take them. Not so today, and 
even less so tomorrow. As the percentage of those with 
some college education rises to be a major fraction of their 
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age group, college becomes a giant sieve through v.hich 
society sorts out those who can succeed from those who 
must accept what is left. When this happens, and it is al- 
ready happening, the opportunity to attend college is no 
longer a luxury but a necessity and when it is a necessity it 
will rapidly become a right. The growing demands of 
minorities for an opportunity to attend college is based at 
least in part upon their perception of a selection process 
based upon the college experience. These demands will 
grow as the noose tightens. 

This seems to be an appropriate point at which to 
suggest a few principles to reflect upon. 

The first principle is that the ability to exclude 
people from an opportunity in our society is in inverse pro- 
portion to the percentage of the population that is included 
and to the importance of that opportunity to participation in 
future benefits of the society. 

The second principle is that the ability !o exclude 
people from a benefit of our society is in inverse proportion 
to the public tax dollars invested in providing that benefit. 

These arc hardly in a class with Newton's Laws but I 
believe they state with some accuracy what has already 
begun to happen in higher education and to what I believe 
will happen at an accelerated pace in the future. 

Continued Expansion 

The proliferation of community colleges throughout 
the nation, the growing attacks upon the traditional admis- 
sions processes at colleges and universities; the initiation 
and expansion of state scholarship programs and the "open 
admissions** policy adopted at my own institution arc all. in 
whole or in pari, reflections of the operations of these 
principles. I cannot imagine that the pressure will subside. 
Those who must predict what the future holds would do 
well to consider the probabilities of universally available 
higher education and how such a public policy might affect 
their institution. Even private institutions which might too 
readily relegate the implementation of such a policy to 
others should pause to reflect on the real possibility that to 
the extent that they do or might receive public subsidy they 
may be expected to participate in the solution of this public 
problem. 

It also seems safe to predict that within a relatively 
short time the loose relationships that have characterized 
the internal operations of the campus arc going to become 
increasingly formalized. This is a euphemistic way of 
saying that the relationships among the several elements of 
the college campus are rapidly going to be governed by 
union agreements arrived at through collective bargaining. 
Although many may wish to debate whether this is good or 
bad, 1 find such a discussion, if you will pardon a pun, 
academic. The movement has started, it is growing and it 
will not be stopped. Those who think it evil may resist it. 
those who find it sensible may embrace it but in the long 



run it will come and we will learn to live with it. 

On many campuses today, large segments of our 
non-professional employees arc unionized and the number 
increases daily. Within the last few years the NLRB has 
proclaimed its jurisdiction over large and middle-sued 
colleges and universities and each year state legislatures arc 
extending to teachers the right to collective bargaining and 
even the right to strike. Today, faculties at about ten 
percent of higher education institutions in the United States 
arc represented by a recognized bargaining agent. By the 
time a new decade dawns I feel certain that virtually all 
public institutions and most large private institutions will 
be dealing wilh faculty unions of one sort or another. But it 
will not end there. The movement will be slower in 
developing but within the time span we arc talking about 
students will be in this game too. It is highly unlikely that 
they will acquiesce for long to being whipsawed between 
the demands of the faculty and the desires of the 
administration. The era of cffcclivc student unions is at 
least within sight. 

As the formalization of relationships develops it will 
raise many questions about traditional educational 
practices that will have lo be resolved. Among these are the 
role of the faculty in curriculum development, methods of 
selecting, evaluating and promoting faculty, the whole 
question of tenure; and a host of other matters that have 
been part of the mythology of higher education. 

Moreover, it will alter significantly the staffing 
requirements of institutions, record keeping, hiring 
procedures and legal services, all of which will affect the 
allocation of resources. 

A Mew Accountability 

This brings us to our third point. In our recent 
history no matter of public policy has affected us more 
directly or more pervasively than in the area of personal 
human rights. It is true that we arc participating in this 
instance in a major national, if not international, 
phenomenon. But it is significant that previously held 
exemptions arc being withdrawn gradually from colleges 
and universities either by legislative action or judicial 
mandates. 

We arc, of course, most familiar with the anti-dis- 
crimination edicts and the affirmative action programs of 
the Federal government but in many areas the surveillance 
of human rights is mul!i«Jcvclcd. The City University of 
New York, for example, in addition to satisfying Federal 
requirement may be challenged through the union 
grievance procedures, the City Human Rights Commission 
and the State Division of Human Rights. Moreover, any 
individual may take his complaint to each of these tribunals 
consecutively or to several of them concurrently. The 
implications of this for university operations can be readily 
imagined. 
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But those aspects of human rights which are related 
to discrimination are only part of the pictur^ Recent court 
decisions have ranged over a much broader canvas 
including due process in the handling of disciplinary cases 
of both students and faculty, proper procedures for faculty 
appointments and non»reappointmonts, residency require- 
ments for students and the control of student publications. 
These decisions have, in effect, applied genera! public 
policy to campus operations and in the process 
significantly altered traditional relationships and opera* 
tional methods. I am certain that we can expect this trend 
to cordinue both by expanding constraints on areas already 
touched and by taking up operational areas not yet 
affected. Surely the possible effects of this process cannot 
be excluded from our planning if we are al all concerned 
about future reality. 

My final example and one which relates most 
directly to the size and cost of higher education, I shall try 
to encompass with the gcncrnl term "accountability." In 
one sense the concept of accountability transcends the 
general area of public policy since it has captured the 
imagination not only of legislators and governors but of the 
many nonpublic benefactors of our institutions including 
foundations, alumni, corporations and even students and 
their parents. 

For years all educational institutions have been 
aware of the necessity for fiscal accountability in the sense 
that they have been required to assure their constituents 
through independent audits that money received was 
properly accounted for. Many public institutions have for 
years been subjected to varieties of pro-audits of expendi- 
tures which have often promoted the green eyeshade 
denizens of budget offices to faculty-like status. In more 
recent times many public institutions have had to justify 
both new buildings and additional staffing requests by 
extensive analyses of space utilization and class size. And, 
of course, in virtually all institutions, the administration 
and faculty have always been accountable to their trustees. 

But I am speaking here of a different kind of ac- 
countability. It can translate ultimately into the simple 
concept of "more bang for the buck" and reflects a concern 
for both the efficiency and the effectiveness of the educa- 
tional enterprise. Discussions of the new concept of 
accountability arc peppered with terms borrowed from 
industrial managcmcnl-productiviy-cost-bcncfit-and so 
forth but the meaning is clear. The various supporting 
constituencies of higher education arc concerned about 
both the process and the product. The reality of this 
concern cannot be judged by the vagueness of the solutions 
that arc being suggested. 

Unfortunately, we arc woefully unprepared to 
respond to these concerns in terms that arc convincing. The 
product of the educational process is elusive enough in 



itself. When one tries to measure the value-added through 
education the task appears staggering. Yet if we are 
unwilling to try to frame the discussion in our own terms 
then? arc others who will do it for us. probably in ways that 
are less than satisfactory. 

Since efficiency is always easier to measure than 
effectiveness I fear that those outside the academy will 
settle for measures of quantity rather than of quality and 
will focus on teaching rather than on learning. If we arc to 
move the discussion to a different plane we must move 
rapidly to address these questions in our own house. 

It is clear to me from these and other less obvious 
manifestations that questions of public policy arc 
impinging with accelerating frequency and with greater 
pervasiveness on o>ir colleges and universities. The few 
instances that I have mentioned here this morning have 
already had a profound effect upon the operations of some 
institutions and, I believe, will spread to all or almost all 
before this decade is done. 

Changing Public Policy 

New thrusts undoubtedly lurk on the horizon and 
will soon be upon us. Moreover, we have ample evidence 
that public policy does change and we suspect that 
analyses would show us that certain kinds of public 
policies shift more rapidly than others. 

As we plan for the future it is essential that we 
attempt to factor this increasingly important consideration 
into our future thinking. How we go about this process is 
extremely important and those of your who arc here today 
have a vital role to play in that process. 

I have recently read a small monograph which 
detailed the planning dynamics of a major university over a 
period of almost ten years. Since 1 am fairly familiar with 
both the institution, the individuals involved and the milieu 
in which the planning too place, I have reflected a good 
deal on what I read. I have concluded that given the normal 
planning process some very intelligent men devised a 
program based on decisions which at the time they made 
them were almost uniformly correct. Unfortunately, they 
had assumed that the world they were operating in would 
be the same tomorrow as it was today hut more so. The 
world changed and many of the correct decisions became 
disastrously wrong. A large element of the difficulty arose 
from changes in public policy. Whether or not the shifts in 
public policy might have been perceived had this aspect of 
the environment undergone careful ccrutiny one will never 
know. The fact is that it was not done and that the 
decisions were made in the kind of unsuspecting euphoria 
that grips small investors in the stock market just before the 
bears take over. 

Since I have proposed here that public policy is an 
important ingredient in the planning process, that it will 
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become increasingly important in the future! and that, 
Ihcrcforc, it is essential that wo make an effort to predict 
what that policy is likely to be. it seems only fair that I say 
a few words about how this might be done. 

Most obvious is the necessity that if any systematic 
effort is to be made it must be somebody's resonsibility to 
do it. The Office of Institutional Research or the Office of 
Planning seem logical candidates for this assignment. 
There arc several places where one might start. Since 
public policy tends to change slowly and grows through an 
accumulation of individual instances, it might be well 
lo follow carefully the literature of higher education to 
perceive which ideas seem to develop a following. The 
annual reports of foundations, particularly the larger ones, 
arc another source of information not only for what they 
say but for an analysis of those ideas or concerns which 
attract support. Certainly some way of monitoring the 
public policy decisions that arc made in those states which 
tend lo be in the forefront of educational change will 
suggest clues to what might become general policy in the 
future. The public statements of governmental officials — 
governor, legislators, agency heads are another source of 



useful information, particularly if one is alert to ideas that 
tend to reoccur with increasing frequency. Court decisions 
affecting higher education are already monitored by 
scholars who have identified trends that might usefuliy be 
considered by those who must plan for the future. 

What we arc talking about is a form of educational 
intelligence work that gleans information from many 
sources, evaluates it. pieces it together into a meaningful 
mosaic and attempts lo determine how it might affect what 
one wishes to do in the future. It is not an exact science but 
rather the application of analytic intelligence to informa- 
tion. The process dees not guarantee sound decisions but it 
docs insure that a vitally important component of future 
planning will be consciously addressed. 

Planning is both an essential and a hazardous under- 
taking. Predicting the future we have left largely to 
astrologers and mystics. But if planning is to be more lhan 
wishing we musl make an effort to predict what the world 
will be like. If predicting is to be more lhan guessing we 
must do il as carefully and as systematically as we can. 

I wish you luck, 
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There is on increasing concern with program evalu- 
ation in higher education. This concern stems from a de- 
mand for new academic program to meet the changing 
needs of college students and from an insistence that pro- 
grams be properly managed and systematically judged. 

The Carnegie Commission on Higher Education 
(1972) has issued a strong appeal for the development of 
academic programs that would serve the needs of students 
who have not traditionally sought higher education and 
whose motives and interests differ greatly from previous 
students. The clear implication of that appeal is that 
students arc changing and academic programs must be 
changed accordingly. The Commission on Nontraditional 
Study (1973) makes an even stronger appeal for academic 
programs that would serve students rather than institutions, 
permit a degree of flexibility and an adaptivencss that has 
often been advocated but seldom realized, and help realize 
a total learning society that would place no limits on the 
efforts of its citizens lo acquire the skills and knowledge 
they seek. 

Other converging events that spur the concern with 
program evaluation are the federal legislation of the sixties 
that made specific requirements for evaluation and the 
current dominance of economic and engineering concepts 
in educational thought and discussion. The Elementary and 
Secondary Education Act of 1965 (ESEA) gave an impetus 
to evaluation that may indeed have a greater impact on 
education than the act itself. The allocation of massive 
sums for the improvement of education did carry a man- 
date for insuring (hat the money was well spent The 
ensuing disillusionment with the massive programs funded 
by ESEA underscored the need for better methods, skills, 
and techniques for the evaluation of educational programs. 
To quote Malcolm Provus: 

Perhaps before we can build effective new pro- 
grams, we must establish creative new ways to 
monitor and eventually judge the effectiveness of 
such programs. This capacily to evaluate programs 
must ultimately depend upon a management 
theory that utilizes pcrtincnl. reliable information 
as the basis for administrative decisions (1969. p. 
243). 

The dominance of economic and engineering con- 



cepts has emphasized the shift of conceptual focus from 
input and process variables to an assessment of educational 
outcomes. The overplayed theme of accountability is based 
on a concern with efficiency in the utilization of personnel, 
resources, and materials in the educational enterprise. As 
much as educators may disclaim the appropriateness of 
economic and engineering concepts for academic programs, 
they should be nonetheless cognizant that such concepts 
are the dominant ones at the present time. 

The purpose of this paper is to examine the current 
approaches that arc being made to program evaluation and 
to consider some of the implications for academic programs 
in higher education. The effort is predicated on the basis 
that program evaluation is a management imperative for 
higher education and vitally affects the role and function of 
institutional research in our colleges and universities. The 
evaluation of academic programs in the past has not been 
viewed within the larger framework of policy analysis and 
has not been a major concern of institutional research as 
such. Not only have past efforts been spasmodic and piece- 
meal, but the evaluation of academic programs has not 
been well grounded and has often produced results that 
conclict with professional experience and judgment. The 
Coleman Report (1966), the study by the RAND Corporation 
for the President's Commission on School Finance (1972), 
and the much publicized Jencks study (1972) are indicative 
of an increasingly persuasive argument that runs counter to 
our better hopes and expectations for education. In brief, 
these studies raise a number of critical questions for public 
education as it is traditionally valued in American society. 
They leave us wondering most seriously where the diffi- 
culty lies — in the educational programs as implied, in the 
methodology of evaluation as it is imperfectly developed, or 
in the choice of criteria as they arc opportunistically 
employed. The serious implications of such studies strongly 
suggest that they cannot be easily ignored — and they 
cannot be accepted at face value. 

The dilemma posed by the numerous efforts at pro- 
gram evaluation in the past several years is. to say the least, 
cmbarassing. It would seem most advisable then to ex- 
amine recent trends in program evaluation, to understand 
carefully the conceptual and methodological difficulties 
that arc involved, and to seek a better conceptual grasp of 
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the nature and functions of evaluation in general. 

Recent Trends in Educational Evaluation 

There is a well -known but highly embarrassing sus- 
picion that most efforts to evaluate human productivity, ef- 
fectiveness, or well-being wind up on a pessimistic note. 
This is true not only of programs in education but also of 
evaluative efforts in the fields of social welfare, penal cor- 
rections, public health, counseling, psychotherapy, rehabili- 
tation, public housing, and religious conversion. When 
traditional methods of experimental or si-experimental 
investigation have been applied to the problems of human 
betterment, correction, enlightenment, or uplift, the results 
have not been as encouraging as proponents of the 
program, technique, procedure, cure, or remedy had hoped 
in the beginning. Whatever human nature is, it docs not 
appear as malleable, flexible, or plastic as reformers, re- 
vivalists, and crusaders proclaim. Change in human be- 
havior is not easily assessed in systematic, quantitative, or 
experimental fashion and an inherent resistance to change 
has been postulated more than once to avoid the full pessi- 
mism of research findings. 

Perhaps the encouraging feature of the most recent 
wave of pessimism is the growing recognition that the 
scientific methods developed for investigation of physical 
and biological phenomena in a laboratory setting arc not 
adequate for the evaluation of programs seeking to im- 
prove, correct, or benefit human beings. It is not the wrong- 
ness of scientific method that is underscored by this out- 
look but rather the limitations of narrowly construed 
methods in dealing with social, cultural, and psychological 
complexities. 

A changing Notion of Evaluation 

As in so many other changing trends in education, 
the National Society for the Study of Education was quick 
to address one of its yearbooks to a consideration of the 
issue and problems involved. Edited by Ralph Tyler (1969) 
the 1969 yearbook addresses itself to the changes taking 
place in educational evaluation. New needs, conditions, 
knowledge, and techniques are said to foster new concepts, 
procedures, and instruments of evaluation. Massive finan- 
cial support was first given by the federal government to 
the development of new courses in science and mathe- 
matics, then to the social problems of poverty and discrimi- 
nation. Each produced in turn a demand for sound data 
that would guide public decision and policy. Coupled with 
the rapid increase in technological instrumentation, federal 
support of education spurred a concern for evaluation that 
could not be met by traditional test theory and practices. 
An adequate appraisal of new conditions and the applica- 
tion of new knowledge about education as such was 
believed to necessitate new developments in evaluation. 



Merwin (1969) emphasized that change had been 
prevalent in educational evaluation since its inception in 
the 19th century but changing concepts of evaluation were 
called for by the new educational efforts and technical 
developments. Bloom (1969) found one of the major theo- 
retical issues of evaluation to be the degree of specification 
of educational objectives and outcomes. The tasic problem 
is making the desired outcomes of learning sufficiently ex- 
plicit for communication to teachers, technicians, students, 
and the evaluators themselves. There is also the problem of 
evaluating the non-specified outcomes of instruction, 
judging the effect of evaluation on the learning process 
itself, and then assessing the usage of evaluation results. He 
posits that evaluation is more likely to have effect when (1) 
important and relatively stable characteristics arc 
measured, (2) the data are used for important decisions and 
/najor disjunctions, (3) the results become part of the public 
record, and (4) they are used to judge the effectiveness of 
teachers, schools, or school systems. 

Stake and Denny (1969) make the cogent observation that 
evaluation is not "a search for cause and effect, an 
inventory of present status, or a prediction of future success 
(p. 370)." It is something of all three but only if it contri- 
butes to understanding substance, function, and worth. 
Evaluation may have many purposes but should always 
attempt "to describe something and to indicate its per- 
ceived merits and shortcomings." They also point out that 
the successful application of evaluation methodology is de- 
pendent upon people and that one of the most urgent needs 
is for more effective recruitment and training of evaluators, 
This need is not supplied by graduate programs in tests- 
and-measurements or in research-design-and-analysis. To 
realize the potential of evaluation, different concepts and 
techniques are needed. Other needs are better means of 
representing educational goals and priorities, reliable tech- 
niques for assessing instruction and learning materials, and 
simple instruments for gathering opinions and value judg- 
ments. Needed most is the development of formal pro- 
cedures for processing evaluative information and drawing 
inferences that warrant the confidence that is placed in 
them. 

A Sharpening Focus 

The American Educational Research Association's 
recurrent interest in educational evaluation is indicated by 
the April 1970 issue of Review of Educational Research 
and the monograph series it has launched on the subject of 
curriculum evaluation. The growing concern for evaluation 
theory, research, and practice is reflected quite strongly in 
the issue of RER and several of the conceptual shifts in role 
of evaluation are pinpointed quite well. Cohen (1970* 
stressed the radical change in the purpose of evaluation as 
the result of the national ihrust against poverty and dis- 



ERIC 



Cameron Fincher 



crimination. The large-scale programs of the federal govern- 
ment meant that educators were now involved in social ac- 
tion programs and not merely education as they were ac- 
customed to it. This meant further that the whole business 
of evaluation research had been thrusted in the politics. 
This turn of events was a source of confusion to many edu- 
cators who were not prepared for the shift in national goals 
and expectations. 

The AERA Committee on Curriculum Evaluation 
was established in 1965 and commissioned to develop 
guidelines for the development and revision of educational 
curricula. The Committee has proceeded on the belief that 
contemporary testing and measurement procedures are 
inadequate and that special observation, data-gathering, 
and decision-making techniques are required. To en- 
courage the development of a more adequate theory and 
rationale for the use of such techniques, the Committee has 
issued several monographs in the series that open up dis- 
cussion in a commendable fashion. 

Scriven's (1957) distinction between formative and 
summative evaluation has been widely adopted. He 
describes the former as the efforts of educators to improve 
curricula during their development and the latter as the 
final or conclusive evaluation that would be made after 
termination of a course, program, or project. Formative 
evaluation is. of course, intermediate in the sense that it 
permits adjustments, modifications, and improvements 
while the program or project is still in a state of 
development. The focus is on deficiencies and weaknesses 
that should be eliminated or on strengths that should be 
emphasized. In summative evaluation the focus is on 
judgments or over-all conclusions that would assess the 
terminal worth or value of the program. The finality or 
conclusiveness of the evaluation is, needtess to say. still a 
matter of relative degree but the implication is that 
summative evaluation borders oa the final word that may 
be had on the subject under investigation. 

Scriven's notion of formative and summative 
evaluation is comparable in many ways to the distinctions 
that Cronbach and Suppes (1969) made elsewhere- between 
decision-oriented and conclusion-oriented research. Tradi- 
tional methods of science are said by the latter to be 
directed to the derivation of general conclusions an'] not to 
the solution of immediate or practical problems. 
Conclusion-oriented research is directed by the researcher's 
own commitments and intellectual interests. He raises 
questions ns the research proceeds and is expected to 
follow leads that may prove more promising than his initial 
or primary hypothesis. It is expected that his final results 
will contribute lo the large body of scientific knowledge in 
the particular area in which he is working. 

Decision-oriented research is conducted for the 
specific purpose of facilitating decisions that must be made 



in the immediate future. The purpose of the research is not 
determined so much by the researcher's interests and com- 
mitments as it is by the needs and dictates of persons ad- 
ministratively responsible for the decision. Time 
constraints and other restrictions are placed on the 
researcher's efforts and he is not free to follow up side- 
leads or by-paths that might prove more interesting than his 
originat charge. When the research is completed, the 
researcher may or may not be free to publish his findings 
in <\ scientific or professional journal. His audience will 
more likely be the administrative, legislative, or public 
authority for which he did the research and his 
responsibility will not be limited to publication of his 
research findings. To the contrary, he may spend months 
explaining his findings to groups of critics, adversaries, and 
others who view his research findings with suspicion, if 
not outright hostility. 

Evaluation and Decision Making 

The most ambitious approach io program evaluation 
has been made by the Phi Delta Kap;ja Study Committee on 
Evaluation (1971). This Committee makes a direct attack on 
the notion that evaluation is "a healthy science, operating 
from a base of well-established theory and methodology, 
and with obvious benefit for all (p. 314)/' Evaluation is 
defined by the Committee as "the process of detineating. 
obtaining, and providing useful information for judging 
decision alternatives (p. 40)." 

The central concept in evaluation, as presented by 
the Committee, is decision. The decision process is said to 
consist of the phases of awareness, design, choice, and 
action, Decisions arc said to be made in a setting that is 
either metamorphic. homeostatic, incremental, or neomobi- 
listic. Decision models that arc applicabtc for the decision 
settings are the synoptic, disjointed incremental, and 
planned change models. The types of decisions called for 
may be cither planning, structuring, implementing, or 
recycling decisions. 

To mesh the concept of decision with educational evalua- 
tion, four basic kinds of evaluation are identified as 
context, input, process, and product. A flow chart, depict- 
ing the basic elements of decision settings, models, and 
types, are believed by the committee to present a total 
evaluation model for use by those who would approach 
evaluation systematically. The extent to which they actually 
synthesize a new definition and methodology of evaluation 
is not immediately obvious. Yet, given the criteria set by 
the Committee, the problems involved in developing an 
adequate theory of evaluation, and the unresolved issues 
that remain, the PDK Committee has written a book that 
anyone taking evaluation seriously should not ignore. They 
have definitely designed wheels that need not be re- 
invented. Yet, the complexity of the evaluation model and 
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the ambitiousness of their efforts to treat all forms of 
evaluation may have resulted in a moie detailed model than 
most persons concerned with evaluation will desire, There 
is a criterion of fruilfulness that remains to be fully tested. 

Evaluation Research 

The emergence of program evaluation as a research 
specialty is depicted more fully by the work of Edward 
Suchman (1967). Rossi and Williams (1972), and Carol 
Weiss (1972). Others could be added to the list, but the 
three will suffice. 

Weiss' test is based on the theme that evaluation 
uses the tools and methods of social research in a context 
of social action where traditional research methods often 
get bogged down. As social research, evaluation demands 
an imposing array of talent. Not only are research skills re- 
quired but also political, social, and relational skills that 
enable the evaluation researcher to utilize his skills for the 
purpose of improving the rationality of social policy. The 
purpose of evaluation research, as stated by Weiss, is to 
"measure the effects of a program against the goals it sets 
out to accomplish as a means of contributing to subsequent 
decision making about the program and improving future 
programming (p. 4)." 

Rossi and Williams believe evaluation research is an 
input to policy analysis. Its purpose is to provide evidence 
of the effectiveness of existing program and proposed al- 
ternatives as a basic guide to decision making. As such, it 
involves both the evluation of program outcomes and field 
experiments that would test the merit of new ideas with 
programmatic implications. Both forms of research should 
be distinguished from onsite monitoring and should help 
improve the social policy process. Rossi and Williams leave 
no doubts that policy-oriented re r earch is indeed political. 
Not only are the problems met> jdological but they are 
organizational and bureaucratic. They state explicily that 
the role of the policy analyst and the evaluation researcher 
is basically forensic. It is their task to gather evidence that 
will persuade and influence those who must make deci- 
sions concerning the program under study. The continu- 
ance, modification, or cancellation of the program may 
depend directly on their skill in doing so. 

As Harold Orlans (1973) has pointed out, the term 
program evaluation occurred only rearely in research litera- 
ture until the domestic programs of the federal government 
proliferated in the sixties. Now there seems to be a concen* 
sus among social scientists familiar with governmental 
affairs that a much needed form of research is one that 
would evaluate the effectiveness of governmental 
programs. 

Yet, Orlans is dubious that social scientists are either 
willing or able to provide the kind of evaluations that are so 
obviously needed. There are basic incompatibilities be- 



tween research as it has been taught in most graduate 
schools and evaluation research as it is needed in the arena 
of public policy. Orlans writes that, "evaluation also faces a 
set of inter-linked moral and practical problems that impair 
its objectivity, insight, and candor (p. 123)." The successful 
evaluation researcher will be hard put to supply the adap- 
tability, ingenuity, and resourcefulness that can produce an 
informed, careful, ana relatively impartial research report. 
The motives to criticise whatever findings or conclusions 
he reaches will be numerous and uninhibited, 

A Conceptual Framework for Program Evaluation 

An emerging research specialty may or may not be 
reflected in the conceptual shifts seen in educational evalu- 
ation by the various committees of NSSE, AERA, and PDK. 
The evidence does suggest, however, that a more sophisti- 
cated form of program evaluation is necessary and that it 
may not be readily provided by persons trained in conven- 
tional research methodology. The difficulties stem from dif- 
ferences in approach, procedure, and expectations; they are 
both conceptual and methodological in nature. 

The conceptual shifts that are involved in the chang- 
ing demands placed upon educational evaluation may be 
summarized as: (1) an increasing emphasis on the use of 
tests and measurements for feedback and direct improve- 
ment as opposed to selection and placement of students, (2) 
an increasing advocacy of developmental, applied, 
practical, problem-solving research as opposed to basic, 
long'term, theory-based research, (3) a lessening of interest 
in conventional experimental research as opposed to re- 
search that is administratively or action oriented, and (4) a 
growing interest in decision-oriented research as opposed 
to conclusion-oriented research. For the evaluation of 
academic programs, these shifts would suggest that a 
heavier emphasis should be placed on formative, as 
opposed to summative, evaluation and that the results of 
evaluation studies will be used increasingly for policy deci- 
sions that will shape or determine program substance, 
form, and content. The extent to which evaluation research 
will be cast in the mold of operations research or insti- 
tutional research remains to be seen. Also in question is the 
extent to which evaluation researchers can maintain 
scienlific objectivity and detachment as these values are 
traditionally conceived. The degree of active involvement 
lhat is implied in some evaluation efforts requires a signi- 
ficant alteration of the researcher's professional role as it 
has previously been viewed. 

An adequate conceptual framework in which to view 
program evaluation would seem most desirable. The model 
developed by the PDK Committee is highly suggestive and 
should help conceptualize the problems and issues of 
evaluation in a more meaningful fashion. There is a 
liability of intricacy, however, that may prevent the model 
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from having the influence it deserves. Persons asked to 
conduct evaluation studies will continue to be drawn from 
traditional fields and may find the model to be needlessly 
complex for their immediate purposes. As a result, many 
beneficial effects will not be gained. 

To provide something of a conceptual framework for 
program evaluation in higher education, a provisional effort 
has been made in Figure 1. No effort is made to treat the 
framework as an operational model or to imply that it has 
elaborate structural features. It is strictly a functional repre- 
sentation of the classes of variables that are involved to 
varying degrees in evaluation efforts. The intent is to 
provide a perspective from which to view the difficulties, 
problems, and issues of evaluation. Many efforts at evalu- 
ation research would seem to suffer from too narrow a 
focus on either the process being investigated or on the 
tangible products or outcomes of that process. The con- 
ceptual framework should help demonstrate that there is an 
optimal distance from which to view most educational 
programs and projects: there is risk involved in standing 
either too close or too far back. It is possible both to 
magnify process variables out of proportion to their im- 
portance and to blur their features to such an extent that 



the process acquires blackbox status. 

The conceptual framework or design has been 
borrowed from Brunswik's writings on probabilistic func- 
tionalism and should suggest the advantages of both 
probabilism and functional analysis. A probabilistic ap- 
proach should help avoid a narrowly construed deter- 
minism that sets the researcher in search of one-to-one re- 
lationships between the several classes of variables. The 
time perspective should help disabuse any researcher of the 
notion that his efforts should serve to link remote events to 
ultimate effects. These two classes of variables are 
provided primarily for boundary purposes and should help 
di< •courage the excessive ambitiousness that some evalua- 
tion studies have been susceptible to in the past. The func- 
tional analysis of distal events and eventual outcomes 
should give any researcher as much as he could hope to 
handle. 

It should be obvious from the conceptual design that a 
choice of variables is crucial to the process of evaluation. 
Proximal events will be identified as those variables that 
have been traditionally classified as independent or experi- 
mental variables while concurrent events will be quickly 
recognized as extraneous variables that must be controlled 



Figure 1. 

A CONCEPTUAL FRAMEWORK FOR PROGRAM EVALUATION 



(adapted from E, Brunswik, "The conceptual focus of some psychological r vMems," Journal of Unified Science, 1939, 8, 36 49) 
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if functional relationships arc to be clearly established. 
Situational factors may be seen as a special class of van* 
ables in that they have an anchoring effect on the decisions 
or conclusions that may be derived from the evaluation, 
This is !o say that virtually all evaluation results will have 
some degree of specificity that cannot be generalized to 
other situations and circumstances. 

Immediate results will be seen as comparable to the 
dependent or behavioral variables that are identified in 
conventional experimental designs. These will be the vari- 
ables in which the researcher will be most often interested 
because they are more accessible, more tangible, and more 
easily communicated to others in decision making posi- 
tions. If, however, there is a serious concern with eventual 
outcomes, the evaluation study must be properly executed 
to that end. The distinction between immediate results and 
eventual outcomes will depend, of course, on the re- 
searcher's own time perspective. The distinclions are 
broadly implied, however, and if eventual outcomes are to 
be treated as dependent variables, the rationale and pro- 
cedures for doing so should be specified. On the other 
hand, if immediate results are to be treated as proxies for 
eventual outcomes, the reasons for doing so should be 
explicit. 

Distinctions between types, levels, and forms of 
evaluation arc not inherent in the conceptual design but 
should be facilitated to some extent by its consideration. 
An obvious inference is that all classes of variables need 
not be included in a particular evaluation study. If the con- 
ceptual framework provides any help at all, it should 
convey the foolishness of efforts or notions that we can 
evaluate academic programs in a total or comprehensive 
manner. The effectiveness of any evaluation effort will 
always depend on the researcher's ability to identify, 



analyze, and interpret those variables that bear most 
directly on the process, outcomes, or events he has chosen 
to study. The choice of variables, therefore, should always 
be explicit and as consistent as possible with the overall 
objectives of the evaluation study. For example, the choice 
of variables in organizing and implementing a system of 
program evaluation should reflect the difference between a 
monitoring system and a means for individual certification. 
Just as testing practices have been dominated by reliability 
theory as a means of providing highly stable measures of 
individual performance, so can evaluation efforts be 
derailed by the mistaken notion that the purpose is to 
certify individual competence. The two approaches are 
different and require different techniques and procedures. 

In closing, it is well to mention that the conceptual 
framework should incorporate without undue difficulty the 
major advantages and Implications of the schema, models, 
and approaches discussed previously. The primary insis- 
tence of the conceptual design is that systematic efforts at 
program evaluation should constitute a functional analysis 
of the variables that are involved and that the nature of the 
relationships derived or established will be probabilistic 
rather than deterministic. It is believed that such a con- 
ceptual approach can help avoid many of the difficulties 
that have been previously involved in our efforts to evalu- 
ate academic programs. The complexities of most programs 
in higher education and the subtlety of influential variables 
would strongly suggest that as urgent as evalwatinn is, it 
will not be easy to conduct the kind of evaluation studies 
(hat arc needed. The methodological difficulties arc stag- 
gering but they a r e not insurmountable, There is every 
reason to believe that our success or failure in program 
evaluation will depend primarily on our solution of the 
conceptual problems that are involved. 
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HOW CAN WE MEET THE CONCERNS OF TODAY WHICH WILL BECOME THE IMPERATIVES OP 
TOMORROW? 

Oscar T. Lennfng, American College Testing Program 



For the past five years I have been coordinating an 
exhaustive literature review on the nonintellective correl- 
ates of different kinds of college program outputs which 
will hereinafter be referred to as "college success."* This 
study was inaugurated in the summer of 1967 by Commis- 
sion IX (Assessment for Student Development) of the 
American College Personnel Association, and has been 
continued under the sponsorship and funding of The 
American College Testing Program (ACT). 

What one person considers success may not be 
success for another, and this is definitely true on the 
college campus. For example, some students merely want 
to persist while others would consider it a failure if they 
did not graduate with honors. Some consider their primary 
purpose to be preparing for a job while others are con- 
cerned about developing their social skills, developing a 
philosophy of life, finding a suitable marriage partner, etc. 
In addition to college success as seen through the eyes of 
the student, college success can be defined from the per- 
spective of the colleges and their officials, the govern- 
mental agencies, society in genera), and interested persons 
such as parents or relatives, etc. 

The initial phase of the project involved searching 
the Psychological Ab r, racts back through 1957 for research 
articles dealing with anything thai might be considered 
college success. These references and pertinent information 
were recorded on specially psrqpured evaluation sheets. 
Over 2,000 references were thus iderYt+tjed, after which the 
sheets were sorted into criterion categortes and then into 
subcategories. 

Once some college success categories and the foci of 
the study had been ascertained, a thorough search of the 
literature was initiated. Between 5 and 6 thousand different 
pertinent references of published literature were found, 
and this docs not include unpublished reports or disserta- 
tions. Furthermore, this figure does not include published 
references prior to 1963 in the grades, persistence, and aca- 
demic learning areas because a targe number of published 
reviews of literature were found which seemed to ade- 
quately summarize the literature for those areas to 1963. 

One of 'he noteworthy results of the project on col- 
lege success wis the development of a criterion classifica- 
tion system with broad categories and subcategories of 



success as defined by various publics. As mentioned 
previously, the categories of college success were, in a 
manner of speaking, empirically derived. For each criterion 
area specified, a number of research studies relating the 
criteria to other variables were found. Some of these 
studies actually attempted to predict the criterion while 
others were concerned only with trying to provide insights 
and to broaden the level of understanding of the criterion. 

About 400 of the research studies were selected for 
annotation. The annotations and references (grouped ac- 
cording to criterion and predictor categories) have been or- 
ganized into two monographs, which are expected to be 
published by the end of 1973. 

As the many studies were critically reviewed to see 
which should be annotated, a number of observations 
about research methodologies and pitfalls were observed 
which should be of interest to institutional researchers. 
These observetions and concerns seemed to be of problems 
that also presently hinder effective college program evalua- 
tion, and they are the topic of this paper. 

I am not trying to equate "educational research" with 
"program evaluation" in this paper. For example, evalua- 
tion must often utilize rough indicators which would not 
qualify for designation as formal research measures, and 
much of program evaluation does not involve use of 
statistical tests. Evaluation should be a continuous process 
that starts with the beginning development of a program 
and continues throughout the life of the program. It is an 
ongoing process that is continually feeding back informa- 
tion to the program coordinators and others. Furthermore, it 
changes and refocuses as the program is modified in 
response to such feedback. An educational research project 
on ihc other hand tends to be strictly summativc in nature 
with pre-established research hypotheses as guidelines for 
the research study. 

What I have been talking about is "formative evalua- 
tion." After the program is operational, much of the 
formative evaluation data is pulled together into "sum- 
mativc evaluation" form, and usually some additional 
overall evaluations of the program outputs are conducted. 
This summativc evaluation is in effect local educational 
research or institutional research, and many of the 
published studies of college outputs were of this type. 
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When program evaluation reaches the summative stage, it is 
helpful to be able to compare your evaluation experiences 
and results with those obtained for similar program at olher 
colleges. The discussion throughout the remainder of the 
paper focuses on this aspect of program evaluation, 

The Research Pitfalls Noted 

In a delightful address in 1965 to Division 14 of the 
American Psychological Association, Marvin D. Dunnelte 
(1966) outlined six "fads, fashions, and folderol in 
psychology" which he felt summarized what was wrong 
with the profession. Several of his points are very much 
applicable to the research on college success which was 
reviewed. His first heading was titled "The Pets We Keep" 
or alternately "What Was Good Enough for Daddy Is Good 
Enough for Me." He was talking about a premature 
commitment to a particular theory or research method. The 
analytic methods used in a number of the studies raised 
questions of appropriateness. Perhaps the reason some of 
these studies used inappropriate methods was that the 
researchers had a "pet" method they tended to always use 
or perhaps many of them were unfamiliar with other more 
appropriate methods and did not have access to a 
statistician. 

Something that may be contributing much to the 
problem of using inappropriate methods is our system of 
graduate education, tt is questionable whether the majority 
of graduate schools in this country arc providing an 
adequate background in research design and methodology. 
Secondly, there 5 s a tendency for particular "schools" of 
thought and methodology to predominate in a university. 
Futhcrmorc, it is probable that some graduate students arc 
overly influenced by the preferences and biases of their 
major professor. 

Dunnette's second heading was entitled "The Names 
We Love" or "What's New Under the Sun." What he was 
talking about here are the imprecise definitions and the 
vague constructs prevalent in various areas of education 
and psychology. He says: 

Perhaps the most serious effect of the game is the 
tendency to apply new names in psychological 
research widely and uncritically before sufficient 
work has been done to specify the degree of 
generality or specificity of the "trait" being dealt 
with. Examples of this are numerous — anxiety, 
test-taking anxiety, rigidity, social desirability, 
creativity, acquiscence, social intelligence, and so 
on — ad infinitum, (p. 345) 

Dunnette's next title was "The Fun We Have" or 
"Tennis Anyone?" In this fad, the researcher gets so caught 
up with computer capabilities or testing null hypotheses 
that he forgets the real problem and also perhaps forgets to 
personally look at the data itself. Dunnette believes this is 
primarily responsible for what he calls the "little studies" 
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or the "little papers" of psychology, which were found to 
be so prevalent in the research on college success. Actuary, 
small studies at single institutions can make important 
contributions to the institution, as most directors of institu- 
tional research can attest. In addition, such studies can 
moke real contributions to the field if they deal with parts 
of important problems and if they can be synthesized and 
integrated. The negative reaction of Dunnette is not against 
such "little studies." but rather against those little studies 
where the research is poorly designed, poorly documented, 
and exploring something of little worth. Furthermore, the 
emphasis throughout the sixties on "number of research 
publications" as an important variable for faculty evalua- 
tion has been a central part of the problem for educational 
researchers outside of the Institutional Research Office, 
Because of this emphasis, some researchers have been more 
concerned with a'dding to their publication list and with 
merely going through the motions of research than with 
making contributions for the good of their institutions and 
for the good of our young people and of our society. 

A final heading of Dunnette's that should be 
mentioned is "The Secrets We Keep" or "Dear God. Please 
Don't Tell Anyone." He reported a paper by Wolins (1964), 
who wrote to 37 authors asking them for the raw data on 
which journal articles were based. Of the 32 authors reply- 
ing. 21 no longer had their raw data. Wolins did rcanalyscs 
on the seven sets of data he was able to obtain and found 
that three of the studies had gross errors which changed the 
outcome of the study, Dunnette includes in this categ.^y 
the following types of problems, all of which abounded u\ 
the reports on studies nf college success: statistical 
difference tests reported without their corresponding 
means, SDs, and the correlations between the two 
variables; experimenter biasing factors; incomplete descrip- 
tions of methodology; failure to carry out or report cross- 
validation studies; and failure to carry out or report replica- 
tion studies. Dunnette also reported, and this may or may 
not be extensive, that some researchers have the improper 
practice of routinely dropping subjects from their analyses. 

It was mentioned that summativn program evalua- 
tion did not always need to involve statistical tests. 
However, when such tests are conducted all necessary data 
for replication and comparison by others should be 
included in the study report. Similarly, the description of 
the total project should be comprehensive enough that 
others reading it have the complete picture and can easily 
evaluate the adequacy of the evaluation study. 

After reading Dunnette's fascinating account, is it 
any wonder that syntheses of a large number of studies in 
the literature are difficult to accomplish? It seemed almost 
impossible to really synthesize the findings from all the 
little studies reported in the literature because of such 
factors as differences in sampling procedures, differences 
in criterion definition, and lack of documentation con- 
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ccrning the design and the results. Through use of a set 
evaluation form, we have been able lo gather as much 
comparable data as possible from each study. However 
many studies did not report all essential data. In addition, 
there were also a number of other serious research pitfalls 
noted in many of the studies reviewed during the project. 

Many of the studies used improper control groups or 
did not use any control group when one was clearly called 
for, For example, no attempt was made in almost all of the 
studies of the institution^ overall impact on student change 
to examine change in comparable nonstudents during the 
same interval of time for which change was being 
examined for college students. Most studies that found 
personality change and other change in college students 
have merely assumed that the college experience was a 
factor in bringing about the changes, e.g., the observed 
changes in autonomy, authoritarianism, dogmatism, and 
independence. Similarly man's studies of the impact of 
particular programs only looked at the change itself, arid 
did not compare it to the change taking place in students at 
this college who were outside of the program, They just 
assumed that the program was involved in the change. 

Concerning studies of change, many of the 
researchers made no attempt to control for student input 
characteristics. For example, it is common for change to be 
related to aptitude, and so aptitude is one variable that 
should often be controlled. 

There arc a number of ways to control for inputs. 
Examples of simple experimental methods arc matching or 
stratification. However, sophisticated statistical methods of 
control such as analysis of covariancc may be called for in 
some cases. Because of a large sample size matching 
procedures may be impractical, and sometimes matching or 
stratification do not give the degree of control desired, 
Stratification gives only gross control on the variables of 
concern. Secondly, the desire may be lo use the intact 
groups for which differences arc to be examined. 
Futhermore, analysis of variance requirements of pro- 
portionality of cell frequencies may prohibit the use of 
stratifying, and matching may distort the distribution of one 
or more of the groups being compared. In addition, it may 
be desired to control on a number of groups and in some 
cases it becomes desirable to later control on unanticipated 
variables. For research strategics in studying change or 
college impact, see Harris (1963) and Feldman (1970). 

Many of the student samples in single-campus 
studies were quite small and they often appeared to be just 
"grab" samples with no real attempt to have representative- 
ncss. Furthermore, many of the small samples on which 
one-tailed I tests were used probably did not meet the 
"normal distribution" requirements for such a test, and a 
two-tailed t test or nonparametric tests should have been 
used instead. Different statistical procedures have different 
distribution requirements. For example, when group 



comparisons arc to be made, the relative homogeneity of 
the groups becomes important. Researchers all too often 
completely ignore such considerations. 

Many studies did not explore the two sexes 
separately. From other studies, it was apparent that there 
were important sex differences on many of the variables 
being explored. To demonstrate the seriousness of this, 
suppose you arc studying change and it happens that both 
sexes change a large amount, but in opposite directions. If 
you look only at change for the total group, you will 
erroneously conclude from your results that no change has 
taken place. 

It would also be desirable in program evaluation to 
examine special subgroups of students within the program 
lo see if the program has differential effects on students 
with different characteristics, For example, in the literature 
on teacher evaluation. Domino (1970) found that 
conforming students tend to do well in a class taught in a 
structured manner and poorly in a class taught in an 
unstructured manner, with the converse being true for 
students with an independent orientation. Most of Ihc 
published studies only examined diverse groups of 
students such as freshman or a psychology class, and did 
not explore subgroups. 

Another methodological problem was the use of 
invalidated instruments. Some studies used locally 
constructed instruments that were poorly designed and 
appeared to never have been field tested in any way. No 
matter what your location or clientele, it should bcvpossiblc 
to try out an evaluation questionnaire ahead of tirrtc on a 
few people rather than relying entirely on "arm chair' 
evaluation of the questionnaires. Hotvever, even some of 
the widely used and accepted personality tests or 
inventories as well as other published instruments have 
questionable validity because of the nature of the 
constructs being studied. Care should be taken in choosing 
such standardized instruments to make sure that they are 
appropriate measures of what you wish to examine for the 
particular program you wish to evaluate. The specific goals 
of the program arc crucial in making such decisions. 

A final problem noted was the "heller skelter" way 
the social science professions have of disseminating 
research results and of applying them to practical situations 
so that they will eventually have a genuine impact on the 
student and his college and on society. Not only is there a 
lack of coordination in communicating research results, but 
much of the research is quite old by the time it is 
published. A number of institutional researchers have 
made good progress in overcoming some of the communica- 
tion problems within Ihc institution. One reason for this is 
that institutional research people tend to be much more 
oriented to research application than arc academic 
researchers. Futhermore. most of their research is designed 
to provide direct decision-making assistance. Because of 
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this research emphasis, many institutional researchers 
make conscientious attempts to summarize their data into 
charts and other forms that arc easily understood by non- 
statistical people; to write up separate, short, and eye-catch- 
ing reports directly aimed at specific college officials on 
their campus; to emphasize those results which have the 
most practical significance: to make use of media such as 
the faculty newsletter and the campus newspaper for com- 
munication when appropriate, etc. Even so, such people are 
continually trying to improve their Intra institutional com- 
munication methods. 

Institutional researchers rnve in the past been at a 
disadvantage when it came to communication among 
institutions. Research journals were generally not 
interested in decision-making studies limited to one 
campus, and institutional research conferences were few 
and far between until the decade of the sixties was well 
underway. One problem, of course, was that until the 
1960 s institutional research was universally carried on by 
many departments and people throughout each campus, 
and there were no central institutional research offices to 
coordinate and assist in such research efforts, and to focus 
on campus-wide research concerns. Hopefully, the ERIC 
system will continue to make progress in reforming our 
research inter-institutional communication system, but 
something more is needed as suggested in the following 
section. 

Conclusions and Recommendations 

The theme for the 1973 AIR Forum is "tomorrow's 
imperatives today." One of the subthemes concerns 
"educational program imperatives," which includes 
program evaluation and research on student and college 
outputs (college success). An imperative for tomorrow in 
this area, that has been of more and more concern the last 
several years, is the need to provide clear-cut evidence to 
governing boards, legislatures, and other concerned publics 
about whether an institution is accomplishing all of its 
objectives. Another imperative is that local research not be 
done in isolation but that it contribute to overall knowledge 
about students, educational programs and methods, and 
institutions. The previous section outlines some important 
reasons why we have not been able to meet such needs at 
the present time. 

As the decade progresses, and inflation and taxes 
continue to rise, the pressures on institutional researchers 
to do a better job of program evaluation will probably reach 
unprecedented levels. They wilt be forced to use more 
appropriate evaluation methods and to cooperate more, and 
they in (urn will put pressure on those in measurement and 
basic research to develop more concrete and useful 
measi es of program outputs for institutional use. 

What are some possible solutions to the 
methodological problems outlined? Three possible 



solutions, which arc not mutually exclusive but which are 
all probably quite controversial, are proposed in this 
section, 

One possibility concerning the methodological 
problem mentioned in the preceding section is for 
graduate schools to provide a better background in research 
and evaluation design and methodology. Such a long-term 
development should conceivably help the situation. 
However, a report by Novick (1972), although it would 
appear to encourage better training in statistical methods 
and research design, questions whether adequate training 
in statistical methods will solve the problems outlined 
unless the skills are used often enough for the researcher to 
maintain them at a high level of efficiency. Novick's report 
further suggests that computer systems may be developed 
which can supplement and possibly even supplant some of 
this desired training, as indicated in the following quote 
about a prototype computer-assisted data analysis system: 
(Even those with) substantial training in, 
understanding of, and competence in statistical 
methods . . . are unlikely to exercise those skills 
often enough to maintain them at a high level of 
proficiency. These investigators can use and are 
typically receptive to guidance in their statistical 
work provided they remain in control of their own 
analyses. Investigators with less statistical skills 
will benefit from even more directive guidance 
through the maze of detail required of good 
statistical practice. For all investigators, the tedium 
of computation or alternatively, the maintenance 
of esoteric computer expertise, is a regrettable 
hindrance to their function of extracting meaning 
from data. 

The system described here is an interactive 
computer-based system for assisting investigators 
on a step-by-step basis in the use of a particular 
anatystic tool — Bayesian analysis using the two 
parameter normal model. The example is meant to 
be suggestive of the kinds of computer-assisted da- 
ta analysis programs that can be developed for use 
by scientific investigators. Programs such as these 
can also be used in the classroom and laboratory 
for teaching purposes, but beyond this they can be 
used by the practicing scientist in his day-to-day 
work ... An important feature of this program is 
that it interacts with the investigator in the English 
language. The investigator need not be familiar 
with computer languages or with the internal 
workings of the computer. He need only learn how 
to sign-in and sign-off the terminal and to make 
simple alphabetic and numeric responses, (pp. 1-2) 

It would seem probable that such "computer assisted 
data analysis system" capabilities could be inexpensively 
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distributed to the various campuses through the use of ter- 
minals from a central computing facility. In addition to 
guiding the selection of samples, the selection of proper 
statistical analyses, and the actual computational 
procedures, the system could conceivably be programmed 
to assist the researcher to avoid pitfalls in the interpretation 
of his study results. Also, as new and improved statistical 
techniques (e.g., better ways to control for complex inputs) 
arc developed, these could be incorporated into the system 
without having to worry about their misuse. New technical 
developments like this, and computer systems being 
developed by agencies such as the Western Interstate Com- 
mission for Higher Education (WICHE), could be invalu- 
able aids in meeting the methodological imperatives for 
research in the future. 

Another possible part of the solution may be for con- 
sortia among researchers and among colleges to become 
commonplace and in each case it would be essential that 
there be good coordination so that the small parts of any 
study would facilitate one another in a planned way. Many 
consortia In the past have failed or been largely ineffective 
because of poor leadership and coordination, a lack of real 
commitment on the part of participants, or related problems 
such as a lack of follow-through and cooperation by partici* 
pants. Yet there have been some consortia that have been 
quite effective and successful, e.g., the Central States 
Colleges and Universities (CSCU) Consortium which has 
been active since 1957. Hopefully, through careful planning 
(including pilot projects to try out the concept), proper 
leadership, and emulation of procedures used in previously 
successful consortia, the pitfalls of many people working 
closely together from widespread localities could be sur- 
mounted. 

Effective consortia could allow expert design con- 
sultation to take place as a routine matter. Coordination on 
predictors, methods, and criteria could allow all of the little 
studies that make up a consortium to add up to a significant 
whole that could indicate how colleges of different types 
and in different regions of the country differ, They would 
also allow many of those small institutional research 
studies that are now considered too insignificant to be 
published by a research journal to add to the basic 



published educational research literature after meeting 
local institutional research needs. In addition, they could 
give people who are outside of a central I.R. office, who 
have access to data but who do not have enough confidence 
in their icscarch abilities to do research on their own, the 
opportunity to take part in significant research endeavors. 
Futhermore, the widespread development of such con- 
sortia, each consorium study attacking a specific priority 
problem that has been agreed on by the coordinating 
agency or person and the participants, might do away with 
much of the emphasis on "faculty research quantity rather 
than quality." Quality would be built into the system. 

Individual initiative within the project and indi- 
vidual supplemental evaluation outside the project would 
be encouraged. Certainly you would not want to interfere 
with the initiative and creativity of the individual resear- 
cher or evaluator. Participation in such a cooperative 
research and evaluation effort could also provide excellent 
learning experiences for graduate students. 

Who would initiate the idea for a particular con- 
sortium study? Presumably people with particular program 
needs who would like to cooperate with others. Profes- 
sional associations, such as AIR. or other agencies could act 
as clearinghouses and publicize throughout the country the 
fact that particular projects had been proposed to study par- 
ticular problem on college campuses. A regional setup 
might be even more desirable. 

Whether widespread applications of the possible 
partial solutions proposed here are realistic or not, only 
time will telL They are presented here primarily to 
stimulate discussion and thought. There may be other 
possible solutions that hold more promise. 

Whatever direction we go remains to be determined, 
but it seems safe to say that the educational-program 
research imperatives of tomorrow call for new research 
priorities and a new research outlook. Reappraisal and 
redefinition must take place; new and specific criteria and 
predictors must be explored; methodological and 
philosophical pitfalls of the past must be avoided; and steps 
must be taken to maximize the practical impact (on the 
college, on students, on college faculty and staff, on society, 
etc.) of such research. 
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A DETERMINISTIC MODEL FOR INVESTIGATING THE FEASIBILITY OF YEAR ROUND OPERATION 



C.J. Christie and D,/. Hipgrave, Woods, Gordon & Co. 



There have been numerous public statements in the 
past several years by business, academic, and political 
leaders favouring the all-year operation of universities and 
colleges. In most cases, the suggestion to switch to year 
round operation is based on the argumenl that Ihere is a 
need for a more complete and efficient utilization of educa- 
tional facilities and that the biggest single factor contri- 
buting to the low overall university utilization is the 
summer shut-down of undergraduate instruction. Other 
argumenls suggest that an all-year university operation 
would help students complete their education and become 
financially self-sufficent at an earlier age, while at the same 
time removing from the economy the need to provide a 
large number of jobs to sludenls during the summer 
months. 

Mr A.C. Scrivener, President of Bell Telephone 
Company of Canada, recommended in June 1970 to the 
Canadian Chamber of Commerce that Ihey give leadership 
to a review of university operations. In particular Mr. 
Scrivener proposed that universities operate two six-month 
terms each year and that work-study programs be 
expanded. In this way. he felt that better utilization of the 
university facilities would be achieved and that sludenls 
could more easily earn their way through university by 
alternately working and studying in these six-month terms. 

The Honourable William Davis, then Minis of 
Education for Ontario, spoke in Thunder Bay in Febiuary 
1971 indicating that he looked favourably on proposals for 
lengthening the university year to permit honours students 
to get their degrees in three instead of four years. The 
Globe and Mail, in Iheir edilorial of February 3, 1971. 
commented favourably on Mr. Davis's remarks. They 
continued by saying that Ontario's grants to universities for 
both operating and construction had increased to $495 
million that year from $155 million in 1965-66 and that "we 
can't stand another five years of high budget increases.'* 

The Clobc and Mail continued their support for the 
"12-month university year'* in a later editorial (written after 
Mr. Davis became Premier) pointing out that Prime 
Minister Trudeau and the Secretary of Stale, Gerard 
Pelletier, appeared to favour extension of the university 
year, Mr. Trudeau said: "If we didn't have this type of 
school year we have now which is based on an agricultural 



society where people attended universities and schools 
during the winter months and in the summer they worked 
on the farm in order to pay for their winter it is certain we 
wouldn't have this bulge of young people looking for work 
in the summer, and to try to meet that we are trying to 
convince the provinces, they they should be more and more 
considering the full academic year, without this summer 
break." 

Mr. F. Lazar, a doctoral candidate in economics at 
Harvard and regular commentator in the Globe and Mail on 
trends in the Canadian economy, wrote in the April 13, 
1972 issue: "It is generally accepted that the current 
structure of the post-secondary academic year does not 
fully utilize the existing facilities. Thus the average tax- 
payer may rightfully inquire whether a plan for a funda- 
mental restructuring of the school year cannot be 
developed so that it not only will provide for a more 
efficient use of educational facilities (and perhaps 
moderate (he costs) but also will improve employment 
prospects for students. " 

These quotations reflect the views, we believe, of a 
large number of Canadians who feel that year round 
operation of universities is desirable and thai one of the 
major benefits of such action is an improvement in 
efficiency and a corresponding reduction in total costs lo 
society. Is this assumption of increased efficiency and 
reduced total costs in fact correct? Most of the people who 
make such statements assume it to be obviously so but 
seldom have done an in depth analysts of (he economic 
consequences of year round operation. 

In August 1971 the Commission on Post-Secondary 
Education in Ontario awarded a contract to Woods. Gordon 
& Co. to undertake a study on the "Organization of the 
Academic Year." The main objectives of that study were: 

1. To describe the options in the organization of the 
academic year. 

2. To examine the merit of these choices. 

3. To estimate the effects of Ihc various choices on 
operating and capital costs of post-secondary 
institutions. 

An important feature of this study was to be the use 
of quantitative modelling to estimate ihose operating and 
capital cost effects. 
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Our presentation today will ignore all of the many 
other advantages and disadvantages of year round 
operation and will deal with the one issue which is 
generally taken for granted — "Is year round operation 
more efficient and less cosily to society?" 

Model Formulation 

U became quite clear at the ou',set of this project thai 
detailed costs for a university, and in particular costs in a 
form which could be related to year round operation, were 
not readily available. This ruled out the approach of 
attempting to correlate costs with some key variables and 
selecting the best fits as a basis for the model. The decision 
was made at this stage to base formulation of the model on 
aggregate cost figures (Statistics Canada, Department of 
Colleges and Universities of Ontario) and from data 
obtained at a Canadian university. The latter was chosen 
because of its experience with the trimester program and 
because detailed cost figures were readily available. Having 
formulated this model of a "typical" Ontario university a 



parametric analysis was undertaken whereby the important 
variables were independently assigned different values and 
the effect on total systems cost could be observed. Exhibit I 
shows the key variables that were assigned different values 
or a range of values in the analysis. Other variables are 
important in this analysis but only those which were 
allowed to vary are shown. These were chosen because 
they were the variables considered to have economic 
importance in going to year round operation. 

The model uses total costs over a 20 year period 
(1971 - 1990) in comparing academic calendar year alter- 
natives. The method used was to select a parameter set 
(specific values for total enrolment profile, section sizes, 
retention rates, plant utilization and net assignable square 
feet per student) and calculate total costs for a number of 
year round alternatives at changing levels of term enrol- 
ment balance for each year (percent of total enrolment 
attending each term) of the time span considered. The 
present value of these costs are calculated and compared 
against that for the standard 4 wo-term program. 
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This approach is illustrated in Exhibit II by showing 
a comparison of the standard two-term program (curve A) 
against a trimester plan with three levels of term cnrolmenl 
balances (curves B, C and D). The upper graph shows 
maximum term enrolments for each of these four condi- 
tions ranging from the; standard program with no summer 
enrolment and a high maximum term enrolment to the 
trimester plan with three equal term enrolments and hence 
a lower value of maximum term enrolment. The lower 
graph in this exhibit is a plot of the total annual costs over 
the span considered for the four conditions. These costs 
include operating and amortized capital costs. The capital 
costs are only incurred when it is required to purchase 
additional plant and this occurs when the curves as shown 
in the upper graph reach the existing plant capacity. Hence 
the points on the lower graph where the <;ost curves 
increase in slope coincide with those points on the upper 
graph where the maximum term enrolment exceeds the 
existing plant capacity and additional outlay is required for 
plant expansion. This point would occur earlier for the 
standard program as shown and later for the trimester 
program indicating the capital outlays are delayed as the 
balanced term enrolment condition is approached. In addi- 
tion the slopes of curves decrease as the balanced term 



enrolment condition is approached indicating that the 
capital outlays are reduced as the total enrolment is spread 
more equally across three terms. It must be remembered 
here that these arc not actual results obtained but rather a 
basis upon which the model was formulated, 

The initial slopes on the curves in the lower graph 
indicate a base of annual operating costs which increase in 
accordance with the increase in the level of total enrolment 
over the time span. These annual operating costs initially 
assume that each course is taught in at least three classes 
and there is therefore no increase in instruction costs in 
going to extended year operation with a trimester program. 
There is however an increase in the level of the operating 
costs from curve A to D and this is accounted for by the 
increase in operating costs other than instructional costs 
which arc proportional to the increase in the academic year 
length and the extent to which the trimester program 
achieves a balanced tern* enrolment condition. Exactly how 
this is accounted for in the model is explained later in this 
paper. 

The model calculates the present value of the total 
costs of B, C and D and relates this to the present value of 
the total cost of A. Assuming that the present value of 
cither U, C or D is less than A, then the indication is that the 
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trimester program at some level of term enrolment balance 
is economically attractive and should be considered as a 
feasible alternative. However ihe analysis docs not stop 
here bul must go further to convert Ihe results into 
operating decision rules. Recall that the assumption was 
made that each course in the standard program was taughl 
in at least three sections and also that the increase in base 
operating cost in the trimester plan did not include instruc- 
tional cost increases. This assumption is now relaxed and 
the model allows the section sizes to reduce in the trimester 
program with a corresponding increase in instructional 
costs such that the present values of the two systems arc 
made equal. 

This indicates what section sizes must be achieved 
in the alternative program to at least make it cconomicaliy 
equal to the standard program, The critical value in this 
analysis is therefore section size (class size). 

Academic Policy Implications of Model Results 

Experience at universities has indicated that the 



success of trimester or quarter operation depends on 
balancing off the increase in operating costs by the savings 
in capital costs with these plans. The high operating cost 
results primarily from the decision to maintain a full course 
offering in the face of lower term enrolments, particularly 
in the summer term. If a university operating a standard 
program has the majority ot its courses offered in multiple 
sections, this increase in operating costs will not be great. 
However, if the majority of a university's course offerings 
arc given in one section only, many new sections will have 
to be opened and, with the same general level of overall 
enrolment, the section sizes will be reduced in switching to 
a quarter or trimester plan. It then becomes of interest to 
determine what mean value of section size will make the 
discounted cost of the standard program and the alternative 
under consideration equal. These section size values at the 
breakeven point are referred to as the critical section sizes, 
The critical section size values arc directly 
dependent on the saving in capital costs minus the increase 
in operating costs for the year round alternative under 
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Exhibit IV 
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consideration. This is because the difference is converted 
into a section size reduction to the critical value if the result 
is positive and an increase in section size it the result is 
negative. 

If the difference is exactly zero, then the critical 
section sizes are the section sizes present in the standard 
program and the indication is that there is a fair trade-off 
between the savings in capitnl costs and increase in 
operating costs. Hence, nothing is to bo gained 
economically in switching to year around operation. 

The policy implications of this analysis are that the 
university must regulate its course offerings for the 
trimester or quarter plan so that the resulting mean section 
sizes aro equal to, or greater than, the critical values. 
Course offerings for the year round alternative which result 
in section sizes less than the critical values indicate 
uneconomical operation. 

In predicting whether an institution could maintain 
mean section sizes at the critical values if it switched to a 
year round alternative, the academic policy-makers would 
have to determine the number of repeated sections for each 



course offering under its present system. It could then be 
possible to determine the extent of adjustments in course 
offerings necessary to maintain the critical section sizes 
under the new plan. For example, if an institution were 
operating under a standard two-term plan and each course 
were offered three times (in three sections) then switching 
to □ trimester plan would not result in a decrease in section 
fizes and no increase in instruction cosls would be 
incurred. 

If each course in the standard program were offered 
in a single section and it was decided to switch to trimester 
operation, then instructional costs would triple with a 
complementary reduction in mean section sizes to one- 
third their originaNevel. If these section size values were 
below the critical values calculated in the model, the only 
choice left would be to drop courses to increase section 
sizes to at least the critical values. 

Summary of Model Results 

Many computer runs of the model were made to 
show the effects on costs and critical section sizes of 
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changes in the key input variables, Tho approach was lo 
change the value of one particular variable such as section 
sizes and compare the results of the run for the year round 
alternative to the results of the run used as a benchmark, 
(i.e. the standard semester system). As mentioned earlier 
changes were made in total enrolment, term enrolment 
balance, section sizes, retention rates, plant utilization and 
net assignable sq. fl per sludent. These changes were made 
one variable at a time so that the effect on total costs and 
critical section sizes to a change in this variable could be 
isolated. 

The following important conclusions are based on 
ihe model results. 

a) The quarter system wilh the same freshman enrolment 
pattern as all other programs is economically unattractive 
under all operating conditions that were examined in Ihe 
model, and should be ruled out as a feasible alternative. 
Exhibit III shows that the present value of tolat costs for 
the quarter system is greater than the present value of 
total costs for the standard semester system for all values 



of term enrolment imbalance levels, This was found to 
be true for all parameter sets examined in the model. To 
sec how this looks on an annual cost basis Exhibit IV 
shows a plot of total annual cost for the years from 1971 
to 1990 for the balanced term enrolment condition. The 
total annual cost curve for the Quarter program never 
crosses the cost curve for the standard semester pro- 
gram over the years considered, 
b) The model results indicate thet there may be some 
economic advantage to be gained in switching to a tri- 
mester-program. As Exhibit V indicates the present value 
of the trimester program is less than that for the standard 
2 term program particularly at the balanced term 
enrolment condition ($123,282 vs. $127,937). This allows 
a maximum reduction in average year round sec lion sizes 
of 6,1% for the trimester program at which poinl Ihe net 
present values of the Iwo systems are equal, Exhibit IV 
shows that the lota! annual cost curve for the Irimcstcr 
program crosses over Ihe cost curve for Ihe standard 
program in 1975 and remains at a lower value for the 
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rcmaincr of the lime span considered, 
c) Amortized capital costs make up a small portion of 
total annual costs in the university system as determined 
in the model. This is caused by a levelling off of student 
enrolments over the twenty years simulated and this 
factor has an important effeel on Ihe economics of year 
round operation. Exhibit VI shows capital cost and Iota! 
cost plotted against years for the standard two term 
program for 1971 utilization factor of 90% . Also plotted 
on this graph are annual operating costs and maximum 
term enrolments. As explained previously, capital costs 
are a function of the 1971 utilization factor and the 
maximum term enrolments and for Ihis case account for 
approximately 12% of the total annual costs of the 
system al their highesl level. As the 1971 utilization rate 
is reduced, it is reasonable to expect that capital costs are 
reduced and therefore 12% is the maximum percentage 
of total costs that is reach d. 

Since the economic advantage in switching to year 
round operation is based on some saving in capital costs 



over an increase in operating costs, the absolute value of 
capital costs is an Important factor. With the projected 
stabilization in university enrolments, capital expansion 
is no longer required after a certain time (approximately 
1981 in the model) and therefore the economic advantage 
of year round operation would be decreased, 
d) There is a fair trade-off between savings in capital 
costs and increases in operating costs as the enrolment 
imbalance levels in Ihe year round programs are varied. 
Consequently, the level of imbalance of term enrolments 
for the year round alternatives considered has little effect 
on the present value of total costs and critical section 
sizes. 

Exhibit VII shows that year round critical section sizes 
are a flat function of MAD (mean absolute deviation) or 
term enrolment level of imbalance. This points to the fact 
that as the term enrolments approach the balanced condi- 
tion, the increased saving in capital costs in changing to a 
year round program is offset by a corresponding increase 
in operating costs. 
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Exhibit VII 

YEAR ROUND SECTION SIZE REDUCTIONS 
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LEVEL OF IMBALANCE (MAD) 
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c) There appears to be less economic incentive, il any, to 
switch to year round operalion with low values of the 
1971 utilizalion factor. 

Exhibit VII shows the effect of assuming various 
values of utilization rate on the present value of total 
costs. Total costs fo- the standard semester program and 
Ihc Irimcslcr program were compared lor the balanced 
term enrolment condition for three utilization rates (60% , 
70%, 90%). The difference in the present value of total 
costs for the trimester alternative minus that for the 
standard program becomes smaller and in fact becomes 
negative as Ihc utilization rate drops from 90% to 60% . 
This is caused by fewer amounts of capital outlay as the 
utilization rate decreases. In other words, with a 
1971 utilization rate of 60% , the increases in student 
enrolments through i<}90 are served by smaller capital 



expansion costs than for a starling utilization rate of 
90% , which reaches Us plant capacity at any earlier date. 
With reduced plant expansion required at the lower 
utilization values, the reduced savings in capital costs arc 
offset to a larger extent by the same increase in operating 
costs of Ihc year round system. Hence the allowable 
reductions in critical section size values arc less for each 
imbalance level, 
f) An increase in ihc ratio of instruction costs to 
amortized capital costs, with a reduction in average 
section sizes, indicates that there is less economic 
incentive to switch to year round operation. When the 
absolute values of Ihc average section sizes for the 
programs considered were reduced* the present value of 
total costs rose, as did the average value of the critical 
section sizes. 
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Exhibit VIII 
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When the absolute value of the average section was 
reduced by approximately t5% . there was a corres- 
ponding increase in the present value of total costs. 
Exhibit IX shows a plot of percent reduction in section 
sizes versus level of imbalance for three absolute values 
of average section sizes. The percent allowable reduction 
in section sizes falls as the absolute values of section size 
decline. 

This occurs because as the absolute value of section 
sizes decreases, instructional costs and therefore 
operating costs increase. Capital costs remain constant 
and are a smaller portion of total costs, 
g) A reduction in student retention rates caused a slightly 
less than proportionate reduction in present value of total 



costs and had a negligible effect on the critical section 
size values. 

The retention rates were reduced by approximately 
17% and another computer rvn was made to observe the 
effect on output variables. While the present value of 
total costs was reduced by approximately 12% , there 
appeared to be no change in the values of section size 
reductions. This effect is shown in Exhibit X. 
h) A reduction in projected student enrolments caused a 
proportionate reduction in the present value of total costs 
for all programs, and did not significantly affect the 
ranking of the alternatives by cost. 

The projected freshman enrolments in years 1972 
through 1990 were reduced by 20% to see what the effect 
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would bo on the output variables. The enrolment in 1971 
was left the same so that comparisons ■ might be made 
with the present values of total costs derived from the 
previous runs. The present value of total costs was 
reduced by approximately 20% for each of the programs 
and the reduction was slightly lower for the year round 
operation alternatives than for the standard semester 



system. This made year round operation slightly less 
attractive economically than it had appeared with the 
higher enrolment projections. The smaller reductions in 
the present value of total costs for the year round alter- 
natives caused the allowable reductions in critical section 
size values to be less for each imbalance level. This effect 
is shown in Exhibit XI. 
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i) A reduction in Ihc net assignable square feet per 
student caused a much less than proportionate reduction 
in the present value Oi total costs and slightly reduced the 
economic incentive of year round operation. 

When the value of net assignable square feet per 
student was reduced from 130 to 105 (19%), there was a 
slight reduction in the present value of total costs for all 
alternatives (1% -2% ). The reduction was slightly less for 



the year round operation alternatives than for the 
standard semester system because the savings in capital 
expendilures achieved by year round operation were 
reduced while the increase in operating expenses 
remained the same. The effect was to reduce allowable 
reductions in critical section size values for each 
imbalance level. This effect is shown in Exhibit XII. 
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In summary our model shows that the quarter svstcm is an 
uneconomical alternative to the standard semester system, 
that only modest savings can be achieved in switching to a 
trimester system and that for Ihcsc savings to be realized 
certain optimum conditions must exist These include: 
(i) The average section sizes for all classes must bo at 
least at the same level as in the standard two term 



system. This may be difficult if not impossible to attain 
without a major alteration of course offerings. 

(ii) The physical plant must be presently coping with 75% 
or more of its potential student capacity under the 
standard two term plan without a major capital project. 

(HI) The total student enrolment must be evenly balanced 
across the three terms. 
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Future Applications of the Computer Model 

The computer model developed in this analysis 
could be used to forecast the economics of year round 
operation for specific universities and colleges. To do this, 
a detailed cost analysis for the institution under consider- 
ation would have to be made. This would include breaking 
down costs into defined categories as used in the model, or 
other categories particular to that institution. Enrolment 
forecasts would have to be made if none existed, and the 
effect on these forecasts predicted should the school under 
study switch to year round operation. Retention rates would 
have to be determined, not only across academic levels but 
across departments, to determine if there would be 



significant changes by department. The model developed 
for (his study used average retention rales for the province 
which differed only by academic level. Some measure of 
instructional space utilization would have to be made for 
the institution under consideration and this could involve a 
study of class-room use if data were not available. Finally* 
an analysis would have to be made of course offerings and 
section sizes. The total number of courses offered as well 
-is the number of multiple sections for each course would 
have to be determined. Average section sizes by academic 
level would have to be determined for each department 
within the school 
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There are several fuzzy, ambiguous words which 
have recently become fashionable in the political jargon of 
education. Accountability is one. Accessibility is another. It 
would be inaccurate to call these "motherhood" words. 
Motherhood has, after all, acquired a range of fairly specific 
connotations. On the other hand, accountability does not by 
itself communicate any message except that whoever is 
solemnly using it is solemnly using it. He may know what 
he means, although he more probably does not. 

Our aim here is to discuss several different kinds of 
accountability? in operational terms, and to explain why 
we think it importanl for institutional research people to 
be discriminating in the ways they serve the principle. 
We are not attacking the principle of accountability. We do 
insist, however, that unless defined and limited, account- 
ability becomes a popular slogan in whose name all can be 
demanded and nothing resisted. We are especially con- 
cerned with two styles often considered valid for all kinds 
of accountability, namely input / output analysis employing 
measurable outcomes and objective models relying ex- 
clusively on quantitative data. In pr-iclice, both styles turn 
out to be an expensive scramble to assemble and analyse 
quantitative date in ways and at levels inappropriate to any 
useful application of the principle of accountability. The 
argument for what we are against usually goes like this; 
"Universities spend vast sums of public money. The public 
must be assured of the benefits of this spending. The way 
to do this is to collect as much numerical data as possible 
on every aspect of university activities so that the results of 
this spending can be analysed and then justified or con- 
demned." 

Such argument is based on the fundamental assump- 
tion that accountability must show that resources (or 
inputs) are producing intended outcomes. We shall argue 
that the input / output model of accountability is not only 
misleading but dangerous when used as a basis for asses- 
sing the activities of universities. We shall suggest an alter- 
native style of accountability in which the processes of uni- 
versities are judged at each successive level in hierarchy of 
accountability. This style of accountability recognizes the 
nature of higher education and is, therefore, likely to be 
more effective than any other. It is a feature of this style 
that quantitative data and analysis, white important for 
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specific purposes, are subordinate to the role of informed 
observation. And this means that at each level of account- 
ability the level of statistical detail should be compatible 
with the ability and opportunity of those judging to observe 
at first hand and be aware of the extent to which the data 
fails to describe what happens. 

The thrust of our suggestions is implicit in the title of 
the paper, "Subjective Imperative." We should therefore 
took for a moment at the contrasting terms "subjective" and 
objective." We take the term "objective" to mean refer- 
ence to criteria, standards, facts, which are uniformly true 
or held to be universally valid, which are external to and 
unaffected by a particular system of applications. On the 
other hand, the term "subjective" means reference to 
criteria, judgements, interpretations which have to be 
referred to human values or value systems; "subjective" 
does not mean only the personal or the whimsical, nor does 
it rule out intelligent argument or appeal to relevant objec- 
tive circumstances. 

With these definitions in mind we turn first to the 
question: why accountability and what is it? Generally 
speaking, there will always be accountability of some sort 
where there is an express or implied delegation of power 
and responsibility. Most institutions, public and private, 
exercise power and responsibility in order to provide ser- 
vices or perform functions on behalf of groups of people. If 
they do not perform as they are expected to, the power and 
responsibility delegated to them may be withdrawn or 
modified by the delegating group, if there is no delegation 
certain goals are agreed at least in broad outline. 

Assumptions 

In relation to educational institutions, it is useful to 
look at accountability as the process through which mutual 
confidence between detegator and delegalee is sustained 
and renewed and which provides, from time to time, the 
basis on which the terms and purposes of the delegated 
authority may be altered. This process will rely on much in- 
formation, non-numerical as well as numerical. Since we 
arc particularly interested in the kinds of information used 
at each level of the accountability process we have to ask 
ourselves first: why does public discussion lean so heavily 
on quantitative analysis of university activities? The 
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answer lies in the fact thai almost everyone, including most 
institutional researchers applies to universities the assump- 
tions of the input / output model of industrial enterprise. It 
is easy enough to undersland why this should be so. First, 
we believe so religiously in the market place that even 
public spending is thought of and tested in terms of 
marketplace standards. Second, the overwhelming bureau- 
cratic fashion of the pasl decade has been program budget- 
ing and cost / benefit analysis and it is only human to 
embrace fashion. 

Very simply, the assumption underlying program 
budgeting is that all public spending programs can and 
should be organized in the ways pioneered by Alfred Sloan 
for the industrial process. Industrial firms have to plan and 
respond to: demand for their outputs, external standards of 
quality, well understood external regulations, an advancing 
technology which they (with their competitors) control. In 
short, the industrial world operates on more or less direct 
feedback. Atthough large numbers of people arc involved, 
their activities can be monitored and controlled in relation 
to specific goals — production outputs and profits. 

In other kinds of activities where the human factor is 
large and outcomes are less quantifiable, feedback is erratic 
over unknown periods of time and the actions of the people 
involved arc likely to be unpredictable and, more import- 
ant, uncontrollable. This is particularly true when the deli- 
very of a service involves direct interaction between pro- 
vider and receiver (as in welfare) or rests on assumptions 
about Ihe behaviour of provider and receiver (as in war- 
fare). In such instances it is easy enough to see why pro- 
gram budgeting fails. More generally, program budgnijng in 
the public sector fails because it is based on the hubris of 
the social technician who thinks he is — literally — a 
scientist. 

Against this background, we can now dispose of the 
industrial model so far as universities are concerned, 
choosing for illustrations one major output — university 
graduates. Universities can of course plan size and ex- 
pected output of graduates, not without error, as we are 
learning, but without disaster. But after noses of different 
shapes and length have been counted, it is not possible to 
attach numbers to the output of the university. It is not that 
the multitudinous outcomes cannot be measured with pre- 
cision. They cannot be measured at all in any ways that aiu 
significant for the process of accountability. The most ob- 
vious reasons for this are: first, the outcome of university 
experience {even if it could be measured for each indivi- 
dual) is spread over too long a period to provide opera- 
tionally useful feedback; second, the individuals involved 
are themselves playing a part in changing the social context 
which determines what is to be judged. In short, the cost / 
benefit model won't work because most benefits cannot be 
measured and others cannot be identified (although they 
may be imagined). To complete the comparison with the in- 



dustrial model, standards of quality are internal to the uni- 
versity, not external, and they are relative and subjective 
rather than absolute and objective. Similar arguments can 
be made about another major output — the research done 
at universities. 

A growing body of literature in diverse fields 
provides testimony that cost / benefit or input / output ap- 
proaches have not worked for universities. So far. Many 
people studying higher education still have an unwavering 
belief that success is around the corner if only sufficient 
effort and imagination is applied. Meanwhile, their wor- 
ship of the "quantitative and objective" has led them to 
proxies for Ihe benefits and outputs in terms of the inputs; 
that is most advocates of quantitative models for account- 
ability are in reality using input / input construction. What 
harm this might do we shall probe after we have described 
the process of accountability as we see it, 

A Hierarchical Model 

It is helpful to look at the process as a simple hier- 
archical model. It further simplifies discussion to concen- 
trate on the primary teaching functions of universities. To 
make things easier still, we have prepared a table which 
sets out for each level of accountability specific examples 
of quantitative and qualitative information which may be 
relevant at that level. We are assuming that each level is ac- 
countable to the level above for making sensible decisions 
about the resources which have been allocated to it to per- 
form functions which have been implicitly or explicitly 
delegated to it. In other words, the accountability involved 
does not mean demonstrating that specified outcomes have 
been achieved — but that resources have been used effec- 
tively in the pursuit of activities which are judged to have 
worth and value. If we could agree that these activities 
themselves are the product of the university much mis- 
understanding could be avoided. In any case it is the activi- 
ties and not the results of those activities which must tie as- 
sessed in the accountability process. 

We are assuming a university system in which there 
is almost complete delegation to the institution of responsi- 
bility for allocating resources internally and in which funds 
are provided in a lump sum by means of some more or less 
objective formula which does not direct internal budgeting. 
This is the model we know at first hand. While we acknow- 
ledge that many others exist in which resource allocation is 
decided to a greater extent by authorities external to the 
institution, we would argue that it is both more effective 
and efficient to make decisions about the interrelated acti- 
vities of universities at a level where the intricacies can be 
observed at first hand. 

In this hierarchy the most important step in ac- 
countability is that of the university to the government. If 
you examine the detail here you will sec a very large 
number of quantitative items which are developed in- 
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ternalty so that those making allocative decisions do indeed 
understand the intricacies of the interrelated activities 
which have to be provided for. You also see a long list of 
items under the non-quantitative information heading. 
These all have to do with preferences of faculty and 
students, advice from professional groups outside the uni- 
versity, peer judgements of quality {and while quality stan- 
dards are determined internally — external peer judge- 
ments are an important factor in the determination of 
these). In reaching decisions about the allocation of funds 
to activities, judgements must be made by combining the 
informed value judgements of a lot of people with the 
examination of a lot of data to arrive at an institutional 
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judgement. This represents feedback to the budget units 
and individual professors whose accounting at their levels 
about their stewardship of the resources given to them in 
the previous years is a key part of the planning, budgeting, 
evaluating cycle within the institution. The budget formal- 
izes decisions about the ways that powers and responsi- 
bilities delegated to budget units and individual professors 
are to be modified. Such changes will reflect changing 
pruritics about what needs doing as well as changes in 
Liethods aimed at improving overall the effectiveness of the 
instructional process. They may also reflect a judgement 
that some activities do not meet established infernal 
standards. 
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Data Collection and Its Dangers 

In the model of accountability that we propose, very 
little of the internally generated quantitative data goes for- 
ward ^s part of the university's accountability to govern* 
ment. The government should hold the univerisity account- 
able for an effective internal system of accountability and 
very little more. The "more" should of course include 
audited financial statements and enrolment information, 
actual and forecast so that adjustments can be made in the 
interests of a rational jurisdiction-wide system. But, pro- 
vided that the university is demonstrably discharging its re- 
sponsibility for effective self-government, higher authori- 
ties should forego detailed management information on 
faculty work-loads, class sizes, contact hours etc. The most 
frequent reason for wanting such information is to second 
guess the decisions which have been delegated to the insti- 
tution. This information is wholly inadequate for the job 
because the detailed data cannot be interpreted by distant 
bureaucrats or politicians through the lens of first hand ob- 
servation. And the second guessing will be based on com- 
parisons with data from other institutions. Since the data 
will at first not be comparable for the kind of universities 
we are discussing, government officials then demand com- 
parable data. At this point the need to define and limit the 
process of accountability assumes crisis proportions. Aca- 
demic considerations go out the window in favour of 
pleasing the data collectors and the central authorities who 
have decided that they have discovered a "right" way to do 
things. The trade-off here is very clear: an illusion of 
greater accountability — less effective institutions, The 
public is encouraged in its natural belief that "objective" 
measures of performance exist, and that by feeding these 
back into a resource allocation model something like 
"perfect combustion" in the system as a whole can be 
produced. 

The chemistry of perfect combustion, if it were not a 
fantasy, would rely on measurement of what happens to 
students on the output side and what faculty do on the 
input side. Because the art of measuring student outcomes 
is acknowledged to be in its infancy even by those who 
think it has great potential value, analysis has tended to 
concentrate on faculty activities and to assume that these 
can be measured by time spent in doing them. We have al- 
ready indicated the indebtedness of this idea to industrial 
methods. What happens when it is applied? Clocking the 
time spent becomes troublesome because academic activi- 
ties frequently overlap, such as in "preparation for teach- 
ing" and "research" or in "graduate supervision" and "re- 
search," and because they are often not comparable, e.g. a 
"class hour" and a "committee hour." Another oversimpli- 
fication is that everyone does the same amount of work; an 
important fact about universities is that faculty members 
differ greatly in their productivity. In any practical applica- 
tion of the "time spent" measure, these difficulties are 



glossed over by forcing them into an arbitrary fit, This is 
the "input" side of the equation. But the time spent is also 
used as a proxy for the outcome of academic activity, i.e. as 
a measure of accomplishment. This is the "output" side of 
the equation. One can understand the emphasis on what 
professors do because they comprise the most visible and 
a legislative backlash — not simply against the method, but 
ask how the money is being spent and how well the job is 
being done, and to answer both questions by pointing to 
time spent by professors, because the same information ap- 
pears on both sides of the cost / benefit equation. So, the 
assumptions underlying the perfect combustion of re- 
sources, that quantitative measures tell the story, that they 
can be put together to provide analytical reports and objec- 
tive decisions, lead to statements as compelling as "time 
spent equals time spent." 

In terms of accountability, of course, the results can 
be damaging as well as fatuous. As soon as authorities in 
the university or outside indicate that budget decisions are 
to be made on the basis of scheduled (measurable) time, 
miraculously the amount of scheduled time increases. In 
fact it may be both more effective and efficient to reduce 
scheduled time. Indeed this has been happening in many 
universities with the object of providing more informal 
contact between professors and students. 

But apart from the possibility of unintended dis- 
tortions which faculty analysis can produce, there Is a 
larger danger in this and other methodologies which put 
undue stress on quantitative indicators of performance. The 
techniques themselves come to be seen as panaceas for all 
that is thought to be wrong. This leads to expectations of 
the planning / allocation / accountability cycle which are 
totally unrealistic and which will, in the long run, produce 
a legislative backlash - riot simply against the method, but 
against the institutions who helped to create the expecta- 
tions. It is simply not good enough to say that quantitative 
analysis is still inadequate, but if we put enough effort into 
improving the techniques then well have a truly objective 
and reliable standard. We will not. But we will have wasted 
enormous amounts of the taxpayer's money in the process. 

Proper Studies 

The university's accountability should consist only 
of demonstrating that it is seriously concerned with making 
the best use of its resources in its particular circumstances. 
It may be properly questioned fiom time to time about 
particular courses of action but it should not be put in the 
position of proving that what it has done is "right" or 
"best" in some absolute sense. Furthermore, those making 
judgements on behalf of the public should not confuse 
levels of total expenditure with notions of efficiency and 
waste. Deciding on "worth" is not the same thing as decid- 
ing on "waste." An apparently more expensive choice is 
not a more wasteful one if a necessary improvement in 
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quality results. 

We will try to put these prescriptions into opera- 
tional terms. The major element in the accountability of a 
university to a government would be to show that the uni- 
versity's own interna) process of accountability will 
function effectively. How can a university do (his? One 
way is to make available to the government, or its repre- 
sentative buffer agent, internal communications which 
show that decisions are being made and are consistent with 
a real concern for the effective use of public funds. Most 
such documents are nowadays in the public domain and 
are prepared for the purpose of informing the university 
community about the actions of Faculty Boards, Senates. 
Board of Governors. From lime to time these documents 
will refer to and may even describe fully various quanti- 
tative analyses of activities at the university which have 
been developed to assist judgement in making management 
decisions. The most useful of these analyses are likely to be 
fairly simple and they are likely to be mosl convincing 
whej\ they make explicit (he assumptions upon which Ihey 
are based. In the form of accountability which we are 
recommending, however, government or buffer agencies re- 
ceiving documents of this kind will not attempt to use the 
data for comparative purposes with other universities. Nor 
indeed should they use the data for any purpose of their 
own although it would be perfectly in order for them to 
draw to the attention of the university any flaws which they 
detected within the documentation. There is not time or 
space here to go into detail but studies such as that pre- 
sented by Irma Halftcr on"A Ration Index of Fiscal-Aca- 
demic Effectiveness" is a good sample of the kind of 
internal study which demonstrates the right sort of concern 
for the use of resources. At the same time the university 
should show that quantitative analysis is a management 
tool and not a substitute for judgement. Responsible pro- 
cedures for budget making is only part of what needs to be 
done to convince outside agencies that the university is 
holding individual departments, agencies and faculties or 



colleges accountable each in turn. The university must also 
show a capacity for internal self-criticism and change. 
Techniques for systematic review of objectives and 
methods in relation to the use of resources of till kinds 
including students themselves have been widely developed 
in the literature of higher education in recent years. 
Governments and buffer agencies will want to be increas- 
ingly alert to evidence that universities are applying syste- 
matic methods to analyse the correspondence between 
stated objectives and actual objectives. As a corollary 
universities should be prepared to show that they have 
found effective ways of helping individuals attempting 
innovation to offset the conservatism of their faculties. The 
university that is truly accountable will be able to show 
that careful husbandry does not depend cn stagnation. 

Fir illy, institutional research can play an important 
part in the credibility of a university's accounting. In some 
cases, universities have invested heavily in institutional re- 
search not because they believed in its practical value, but 
because they thought it would make a good impression on 
their political masters and ih i public at large and because it 
was a good thing in itself. It is becoming clear that uni- 
versity administrations and institutional researchers, and 
even more government departments, need to apply to their 
own rapidly expanding empires the rigorous systems analy- 
sis which they insist should be applied to general institu- 
tional decisions. The institutional researcher who would 
serve his institution and the public interest best is one who 
asks before embarking on each project— what question am I 
trying to answer? Is the answer going to be worth the cost? 
Can I get an approximate answer from data I already have? 
What does my data leave out? People who use institutional 
research must remember that educational planning and ad- 
ministration and teaching all involve the continual interpre- 
tation of values — and they must hold on to a confident 
capacity for judgement. Otherwise the search for numbers 
in place of judgement may end with losing the ability and 
the right to judge. 
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Underlying most of the current agitation over ac- 
countability is a profoundly important struggle for influ- 
ence over if not outright control of our colleges and univer- 
sities. That struggle is the reality we are dealing with: a 
reality, however, which is masked from view by much 
evasive rhetoric both wiihin and without the academy. In 
order to remove some of the obscurities which are hamper- 
ing our perception, I shall construct and apply some rudi- 
mentary conceptual lenses, by the aid of which I hope we 
may command a clearer view of certain of the problems be- 
setting us. In particular, it will be necessary to examine the 
role of certain dogmas — and myths - 1 which are ingre- 
dients in the situation we confront. 

I shall, in part, be sermonizing; and my text is taken 
from Lewis Carroll's Alice in Wonderland. You may recall 
from that story the remarkable powers and propensities of 
the Cheshire-Cat — in particular, his ability to disappear, 
leaving behind only his grin. Bothered by the habits of this 
strange creature, Alice asks him to perform this feat once 
more: 

"All right," said the Cat, and this time it 
vanished quite slowly, beginning with the end of 
the tail, and ending with the grin, which remained 
some time after the rest of it had gone. 1 

Current Demands on the University 

Let me begin my sermon by reminding ourselves, 
very briefly, of the truly astounding demands currently 
being made upon the contemporary university: in parti- 
cular, upon the large, complex, highly visible, highly dif- 
ferentiated "multi-versity" or its even more fearsome 
cousin "the mega-vcrsity," vis,, the state-wide college and 
university system. 

There is a compact and useful summary of these 
demands in the 1972 Wiche report, with which many of us 
will be familiar. 2 As the Report correctly indicates (and it 
is merely summarizing) we are being admonished to 
''achieve higher productivity" in our educational enterprise; 
to "attain greater efficiency;" to end "wasteful and un- 
necessary duplication;" to get on with the job of "measur- 
ing outcomes;" to demonstrate the "value added" com- 
ponent in the educational process; to be more "relevant;" to 
develop and foster "continuing education" (in addition to 



our existing programs); to be more "open" and "acces- 
sible," especially to "disadvantaged minorities;" to "end 
the abuses of tenure;" lo "eliminate deadwood;" to strive 
for "flexibility" and to abandon "rigidity;" and, at all times, 
to be fully "accountable" — to — "government," to 
"society." and to the "public" at large. (By some fortunate 
omission of dispensation we are. apparently, nof required 
also to be accountable to God and to the Queen.) 

"Accountability 1 * as the Chosen Instrument of Persuasion 
1 shall not spend any time reviewing in detail this set 
oi ten or more dcrriatod3. \Vc are a!! too familiar with them. 
Rather, 1 shall fasten on the term "accountability" — 
which, as Howard Bowen has aptly said, is now function- 
ing as "the chosen instrument of persuasion." 3 It may be 
noted that this term does not even appear as a topic in the 
Education Index prior to 1970. 4 Yet it now figures as a 
prominent theme in a veritable flood of rhetoric: news- 
paper editorials and government pronouncements 
invariably invoke it. Prior to 1970, it was used to refer 
essentially to matters of fiduciary obligation. Now it is 
functioning as a shibboleth, or as a war-cry; or, to change 
analogies, as a term of incantation to rid (he world (and 
especially the academic world) of all sorts of presumed 
monsters and devils. 

Like other currently popular terms (such as 
"relevance." "alienation," "identity crisis," "participatory 
dorr .^/icy," and so forth) "accountability" Is a kind of 
Cv ?t .t wo d or trigger word for an extremely complex, subtle 
and shit 'ng array of phenomena, of ideas, and above all of 
attitudinal stances or values. Depending upon their users 
and their contexts, words of this type shift in elusive 
fashion, both in their denotation and their connotation. As 
heavily value-laden terms, they are most convenient instru- 
ments of indictment and of attack. Declare yourselves 
"alienated;" label Classics as "irrelevant;" accuse your 
department chairman of being "undemocratic" and 
"authoritarian" — and you can nowadays put in train a set 
of emotions and attitudes which are most useful as engines 
of subversion and disruption of whatever "establishment" 
or ancien regime you wish to pull down. No impediment 
stands in your way; who nowadays will be so crass and ill- 
mannered as to hold you accountable for the meaning and 
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use of your words? — especially if you choose to talk of 
"accountability." It is indeed a "chosen instrument of 
persuasion." More bluntly: it is being used as a club. 

Let me avoid a misunderstanding here. 1 do not wish 
to argue that none of the demands being made upon us is 
legitimate. Nor do I wish to suggest thai the attacks being 
made upon us are wholly without reason and foundation. 
We should be concerned, however, about the weight of all 
of these demands, when summed, upon our institutions of 
higher education. It is calamitous for anyone to require the 
university, or any institution, to perform tasks it simply 
cannot do — unless his aim is to distort and break it.* What 
is also of concern is that in this current list of demands 
there is no reference to the tasks which the university is 
uniquely fitted to perform, has (despite its faults) histori- 
cally performed, and which no other institution does or can 
perform. Undiscriminating attack may not rc/orm the uni- 
versity; it is more likely merely to de/orm it. 

Reality I; The Malaise of the Contemporary University 

But is the typical multi-versity in good position to 
respond to these demands as it should? Is it capable, in 
other words*, of resisting ifrcsc demands which shWd bp 
resisted, and satisfying those demands which arc 
legitimate? Is it capable of responding in a coherent, 
systematic and rational manner? No one familiar with our 
present condition could give a confident reply. 

1 do not have th* 1 time to dwell very long in painting 
a picture of the profound mal^'se affecting so many of our 
institutions of higher education. 6 It is obvious to alt, and 
now a commonplace of many reflections, that over the last 
ten years or so we have undergone most profound changes. 
For example, participation in something called "university 
governance" has altered dramatically in the past decade. In 
many jurisdictions academic staTf. otudents, and occasion- 
ally members of the support staff now sit on the highest 
boards or governing councils. Decision-making by 
"consensus," by "participation," instead of by authoritative 
fiat is the order of the day. 7 Yet everyone is disenchanted 
with this grand experiment in democratic governance. The 
New Jerusalem has not materialized. Everyone goes 
fruitlessly about trying to find the real locus of power: 
surely it must exist somewhere? Our students and the 
majority of our younger faculty are convinced that they do 
nol have an effective share in power, despite their 
enfranchisement; and both are quite correct in this 
assessment. "Button, button, who's got the button?" they 
ask in frustration. They are naively convinced lhat 
something called "the administration" must have the 
button of power. Here they are quite wrong: there is no 
bullon. 

Power has been dispersed everywhere — and 
Iherefore is effectively nowhere. "The problem is not 
Concentration of power bul ils dispersion. Inerlia, 



incapacity to respond, is the inevitable outcome. Mfl No 
longer do we have, in any genuine sense, a system; we have 
only what one of my academic colleagues aptly calls "this 
crazily juddering heap." 9 The old "community" has 
dissolved into adversary relationships; we have moved (to 
quote Nisbet) from legitimacy to litigation. J * 

A useful way of highlighting this absence of 
coherence or of system is to consider the quite incredible 
array of models through which the various protagonists in 
the struggle for ownership and mastery of the university 
want to see (and persuade others to see) our institutions of 
higher education. At times, some remnants of our founda- 
tion model come into play: the model of the guild of 
scholars, a model, as Nisbct's magisterial analysis shows, 
rooted in an essentially mediaeval context. This is the 
model which sets in play much of the rhetoric about *'the 
community of scholars," "university autonomy." the 
"sanctity of tenure." and like phrases. 

But other models are not wanting. There is the 
consumer sovereignty model; Ihe public utility model; the 
social service station model; the model of the university as 
"therapeutic community," functioning as a sort of 
"psychiatric day hospital;" 11 the corporate model; and a 
variety of political models. These diverse models (or 
relevant portions of them) play like magnets over the 
elements of the whole, aligning them now in this array, 
now in that, but with no magnet possessing sufficient 
intrinsic power to override the attractions of the competing 
magnets so as to impose and maintain any coherent, 
permanent recognizable pattern or system. In the accurate 
usage of mathematics, the university of today appears to be 
approaching "the degenerate case;" i.e., to be in danger of 
losing those characteristics proper to its genus or nature. 
Power to respond in a rational and coherent way to the 
forces acting upon us in the name of "accountability" is 
becoming small or nonexistent. 

Conceptual and Linguistic Pollution — and ils Effects 

The university is by no means wholly responsible 
for the condition in which it now finds itself. It has been 
caught, willy-nilly, in a vortex of social, economic and 
political forces which are in large pari not of its own 
making. Yet we are not wholly guiltless either, for Ihe 
process of dissolution has been aided and abetted from 
within the academy itself. We have permitted our 
intellectual and linguistic coinage to become debased. Or. 
to borrow terms from the realm of ecology* just as our 
physical environment has suffered pollution from our 
abuse of il, so has our intellectual environment suffered a 
corresponding decay and pollution. And that is something 
which should not have happened in the academy, of all 
places. 

The fact is that we see our environment through 
words and concepts — and we act on it in terms of what 
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we sec. When some one coins a striking word, we see 
things differently, and we then respond differently. Once a 
term like "identity crisis" becomes established, adolescents 
start having "identity crises" — by the millions. Allow 
words and concepts to become muddled and slovenly, so 
that the lenses through which we see become clouded and 
dirty, and we shall soon begin to stumble and to act 
foolishly. 

Lei me illustrate — by reference to the context of 
university affairs. I am rather confident that a generation 
ago we did not go around talking of the problem of "univer- 
sity governance." Very unfortunately, that phrase was not 
smothered in its cradle: it was permitted to grow and to 
acquire undue influence over our vocabulary. By insensible 
degrees, we then began to speak of "the administration," 
using the term to embrace such offices as those of president 
or principal, dean and department head. We thereby (quite 
unconsciously slipped into two serious errors. In the first 
place, we began to obliterate the former clear distinction 
between (say) heads and deans on the one hand and 
comptrollers and similar functionaries on the other, 
Secondly, under the influence of bad analogy, we began to 
speak and to think of all these "administrators'* as clerks or 
"civil servants" — a change not muted in significance by 
insisting on the (relatively trivial) distinction that some 
civil servants are more senior than others. Logic (of a sort) 
now carries us on to the denouement, wherein we find 
"academics" asserting that these mere "administrators" (are 
they not only civil servants?) should be excluded from any 
real influence of senates or boards of trustees. Surely this is 
Alice in Blunderland? Somewhere along the line, we have 
quite forgotten that any institution requires leaders. Indeed, 
words such as "leadership" and "authority" have now 
acquired such an odour as almost to be unmentionable in 
polite academic society: one must apologize for using them. 
The "anti-leadership vaccine" of which |ohn Gardner wrote 
so perceptively seems to have done its work only loo well.' 2 

I am not here engaging in any fruitless exercise in 
nostalgia. (As the wry graffito has it, nostalgia is nol what it 
used to be.) I am simply recalling that, a generation ago or 
even less, the university was embodied in its heads, its 
deans, lis principal or president. Those office-holders 
spoke for Ihe university; they were (or were laken to be) 
exemplars in Iheir own persons of what the university was 
for. They were the moulders and makers of Ihe university; 
they were responsible for its nurture and its growth. 

ltd a word, they were Ihe authorities. In a precise 
language such as Latin, they would have been called 
ouctors. Auctor is related to aucforitas, "authority;" and 
both are related lo the verb augeo, "to cause to grow or 
increase." In our slovenly modern manner o v speaking and 
thinking, we have lost both the word and the concept. In 
the ensyJpg development, we have, quite naturally, lost our 
authorities, our "makers." Of "un-makers," of destroyers, 
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we clearly have a plenitude. Authentic decision-making 
becomes more and more difficult, Here and elsewhere, 
within the university and without, the paramount problem 
is the unmaking of indecision. is 

"Accountability" — Some Conceptual Clean-Up 

In destroying authority, we have simultaneously 
destroyed the necessary conditions of accountability, You 
cannot talk meaningfully about accountability without talk- 
ing about authority. The notion ci accountability entails the 
notion of authority, of a structuring of "offices" within 
some juridicel or institutions 1 framework. Yet many of 
those who insist on more of Ihe former are doing their best 
to ensure that there is steadily less of the latter, 

What, in standard English, is the meaning of "ac- 
countability?" Consider some office-holder, X; for example, 
a faculty dean, If X is to be held accountable for the 
discharge of some duty or trust, then there must be some 
second person (or body) Y, (e.g., the president) who can 
"call X to account;" that is, who can demand that X justify 
what he has done or has failed to do. If X refuses to give 
such an account, or if Y finds his account wanting in some 
respect, then Y is empowered to inflict upon X an ap- 
propriate penalty or "sanction/* or to request some other 
authority to do so. In plain English: the dean can be fired. 
Remove such notions as "sanctions" and "authority" and 
you remove all meaningful talk about accountability, We 
may put this in another way. Impose accountability while 
at the same time destroying authority, and (if you arc so 
minded) you have at your disposal an admirable engine for 
destroying the bonds which hold an institution together, 
which make it a system. 14 

To give force to these comments, let me contrast two 
very different contexts for decision-making. Let us first 
imagine some office-holder, X, operating in a well- 
structured system, who makes (in responsible fashion) a 
decision likely to create some painful consequences. Some 
of the shocks flowing from that decision will inevitably 
recoil on him. The action is reflexive: for the action, there is 
a re-action, as the first law of Newton assures us there 
always must be. If he has made a mistake, he is not only 
blameworthy; he will gel the blame or receive Ihe penalty 
in his own person. When blame can be fixed in this way, 
accountability is present. X's action and role are system- 
conserving. 

Suppose, secondly, a committee (not an individual 
office-holder) is called upon lo make the decision. Im- 
mediately we are in difficulties. Unless we blandly reify 
the committee, there are notable difficulties even in 
speaking of an action and therefore a decision at all. A vote 
can of course be taken; it may even be unanimous; but 
there may in practice be as many reasons, all different, as 
there are members of Ihe commitlee. There may be 
complete formal consensu as to Ihe motion, but con^le-le 
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dissensus as to the rationale. Accountability immediately 
begins to come unstuck, because there is no authoriative 
way even of providing an account of the action. 

A second difficulty is that the necessary condition of 
a sanction is removed, In a loose sense the committee can 
be "blamed;" but there may well bo no way, short of 
executing the whole lot, of bringing a sanction to bear on a 
collective or on its members. The action is not reflexive: 
blame can never be fixed upon any individual member of a 
committee. Uven if it could, what appropriate sanction is 
available? Being fired from a committee, as we all very well 
know, is no sanction at all. Even if sanctions could be 
devised, by the time the adverse consequences appear the 
committee's membership is very likely to have changed, Or 
the committee may even have ceased to exist- It is about a? 
useful to blame a committee as to blame the hurricane for 
destroying your house. To say lhal the committee "acted" or 
is "accountable" is to begin to use woids in a degenerate or 
Pickwickian sense. Relying on committees for advice is 
prudent; relying on them for decision-making is not system- 
conserving but system -destroying. 

The Masked and the Masking Game 

The realities of our situation in the face of the 
demands of accountability — even the legitimate, not the 
spurious demands — are not parlicularly reassuring to 
contemplate. For several reasons we tend to conceal these 
realities in fogs of various kinds. How and why do we do 
this? 

Let me begin with a very simple example — one no 
doubt recognizable to all who have seen academe in action. 
The Faculty of Arts at Puddleberry University is engaged in 
the throes of its quinquennial debate about the curriculum 
for the Arts degree. The Department of Outer Mongolian 
Language and Literature does not have quite the strangle 
hold on the curriculum which it enjoyed at the time of Pud- 
dleberry's founding. Some bold spirits in the Department of 
Ideology have therefore advanced the proposition that OM 
200 should henceforth not be required for the degree. That 
motion is the formal agenda for the meeting of the Faculty 
Council, 

Professor Hapless. Head of Outer Mongolian, will 
have to repel this thrust of the barbarians against the 
ramparts of high culture. Everyone but a babe in arms 
knows that Hapless (is he not human, like the rest of us?) is 
vitally concerned about losing student credit hours (should 
students be allowed to vote wi!h their feet); academic and 
support staff entitlements; resources of other kinds. His 
status and clout in the Faculty are at stake. The struggle at 
the Faculty Council between Hapless and the ideologists 
over these matters constitutes "the hidden agenda" — a 
phrase now a commonplace. 

Can Hapless address himself to the real or the 
hidden agenda? Obviously not. The unfortunate man is 



forced to enter upon a debate about the intrinsic merits, 
high educational values, etc., of OM 200. He must disavow 
any self-interest in the issue, and advance arguments of a 
personally disinterested, moral and rational type, addressed 
to some shared (or once shared) concept of the mission of 
Ihe Arts Faculty of Puddleberry University. Given these 
constraints, Professor Hapless clearly has a formidable 
assignment in front of him; and smart betting is that he will 
lose. 

At this point I want to introduce the notion of a 
game. 1 shall not depart from the standard dictionary 
definition of a game as "a contest played according to rules 
and decided by skill, strength or luck," That is a simple 
enough definition. There is. however, an incredible variety 
of games, depending upon the kinds of skill, strength or 
luck at issue and upon the pertinent rules; and full explora- 
tion of the concept is a most demanding task. 15 Here I shall 
have to avoid complications, noting only that we make 
everyday use of the word in talking about the actions and 
behaviour of others. "What's his game?" "What's the name 
of the game?" are two obvious examples. 

I shall call the "hidden agenda" the hidden or the 
masked game. In its crudest form, the masked game is 
concerned with the simple question: "What is best for me?" 
Professor Hapless, however, is forced by a certain set of 
rules to play another game, which covers up this somewhat 
unpleasant, naked reality. Let us call this second game the 
masking game. 

The masking game always has a standard form, Its 
detailed content will vary with the context. The standard 
form is: "What is best?" or "What is best for . . «?" where 
the blank may be filled by designating any group or any 
cause transcending patently "selfish" concerns. "What is 
best for the students of Puddleberry?" is a move open to 
Professor Hapless What is best for Ihe nation? for the 
Party? for the Revolution? are other possible fillings for the 
basic form. The essential feature is that within Ihe masking 
game, we must always set in play some admixture of the 
moral and (he ralionof. 

Everyone, including Hapless, is aware that he is 
playing the same game — a fact not concealed from them- 
selves, their audience, or from Hapless. (We may be confi- 
dent, for instance, that they will be engaging in much talk 
about "relevance" as a mask for their real interests.) Why 
then all the pretence? Why does not Hapless simply stand 
up in the Faculty Council and state his real concerns? The 
answer is that this option is simply not open to him. If he 
were to drop the mask, and admit to his real game, no one 
else would play with him. There are severe penalties for 
dropping oul of the masking game. To refuse to play by the 
rules and constraints of that game is either to leave or to 
take on the whole organization or institution of which he is 
a member. Almost certainty Hapless cannot afford to opt 
for either alternative. He is therefore forced to play, with 
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the big guns of "relevencc" trained straight on him. 

If you think that 1 am going to condemn the masking 
game t you are quite wrong. It is only the extreme and de- 
gererate case of the game that I shall condemn. In fact, 
playing the masking game (as 1 have defined it) is an in* 
escapable and essential feature of the human situation. 
Aristotle put it succinctly when he laid down the funda- 
mental proposition that by nature all men arc "political 0 or 
social beings. We are neither beasts nor gods; we are half- 
way between. We are not driven merely by brute instincts 
for survival. Nor arc we like the gods — perfectly moral, 
rational beings. We are in a middle condition; and we are 
forced to live within the bonds of some society or asso- 
ciation. Self-interest must be curbed, muted, disciplined by 
moral and rational considerations if that society is to 
endure. In our discourse with one another we must put on 
the mask of morlily and rationality. 

Certainly, the masked game influences, perhaps 
distorts, the play within the masking game, (Some moves 
are just not available to Professor Hapless.) But equally, the 
masking game moderates the play of narrow self-interest, 
which is the name of the hidden or masked game. In a 
healthy, genuine community, the two games interact. The 
mask modifies its wearer. Your three year old child does 
more than merely don the Halloween mask of the witch: for 
that magic hour she is a witch. The mask or persona modi* 
fies the person: persona, indeed, originally meant the mask 
of the actor in the play. The role called for by the mask 
changes us, a fact noted long ago by William James in his 
Principles of Psychology. Assuming a virtue when we have 
it not is the necessary first step in practising the virtue — 
and therefore in coming eventually to possess it. 

"Valence Bonds 1 ' — and the Sustaining Dogma 

The elements of any viable organization are held to- 
gether by certain "valence bonds" — by certain values. The 
masking game must appeal to those value bonds; as long as 
it does so it is a necessary and indeed value-reinforcing 
activity. 

Those values will be found to be embedded in a 
central, sustaining doctrine or set of fundamental beliefs 
held as valid, and functioning as dominant and unquestion- 
able for the particular organization. Such a doctrine is a 
dogma. No doubt at some time Puddleberry had a local and 
compelling version of the doctrine of the community of 
scholars; and that unquestioned doctrine with its associated 
values and beliefs conferred rights and status upon certain 
central disciplines and their professors. As long as the sus- 
taining dogma remains strong, the barbarians will probably 
not dare to invade the realm of Outer Mongolia. They will 
indulge only in reconnaissance forays. But once weakness 
is scented, they will attack. That is why, sooner or later, 
Hapless is bound to lose. Life has already fled from the sus- 



taining central dogma. The case of Hapless is hopeless: 
avoid him at all costs. 

What happens when an organization begins to 
crumble? when its core of values starts to dissolve and the 
valence bonds to loosen? when community is replaced by 
adversary relationships and new power alignments? when 
an institution loses those qualities proper to its nature, i.e., 
when it approaches degeneracy? Then the masking game 
itself becomes degenerate. The moral and rational dialogue 
forced upon us by the rules of the masking game ceases to 
tame and to mute self-interest and partisanship. The sus- 
taining myth or dogma may eventually come to be used in 
the most cynical manner by the contending factions. 

Consider, by way of example, the classic description 
of the university as a "community of scholars." Perhaps 
there was a time when in most if not alt places that expres- 
sion denoted a genuine reality. No doubt there are places 
where it still does. As applied to the typical large, modern, 
urban multiversity, however, the use of the expression now 
makes one distinctly uncomfortable — if taken as a refer- 
ence to a governing reality. As one acerbic writer puts it, 
most debates about '.'university governance" are "part of a 
fantasy about the existence of 'community.' But large urban 
campuses have about as much community as Grand Central 
Station." 16 The expression in such contexts denotes a mere 
fiction: in current usage of the term, a myth. And its use in 
the masking game may become more and more cynical and 
unprincipled. 

For example, over the last few years in many institu- 
tions the "community of scholars" argument has been used: 
(i) by the faculty, to wrest power from the "administration" 
and from the board of governors or trustees; (ii) by faculty, 
with the administration as opponent and the board as ally 
or neutral; (iii) by students, with the faculty as opponents; 
(iv) by students and faculty, with administration and board 
as opponents; and $o on through still other game combi- 
nations. Recently, at my own institution (perhaps others?) 
the local faculty association made an interesting external 
use of the myth — a use which some of my academic col- 
leagues have found somewhat cynical. Applying to the pro- 
vincial Labour Relations Board for formal certification as a 
union, they claimed in their application the president, the 
academic vice-presidents, and all deans as members of the 
union on the ground that since all were members of a 
"community of scholars" all had that true community of In- 
terest into which the Labour Board is bound by statute to 
inquire. The contradiction is obvious: if we are all members 
of a community, what are any of us doing at the Labour Re- 
lations Board — whose role essentially is to organize the, 
fight? 

Reality II: The Accountability Interface 

Thus far 1 have been talking about the institutional 
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scene, and noting the conditions which tend to defeat ac- 
countability within tho multiversity. Some brief comments 
about the interface between the university and the govern- 
ment are now in order. Here too we find a masking of 
reality which is causing serious if not intractable difficul- 
ties for those who have to plan and manage ("manage" is 
flow the operative Word) our colleges and universities. 

Governments nowadays arc fond of posturing cham- 
pions of "accessibility;" as enemies of "elitism;" as true be- 
lievers in full "self-realization" through education for atl 
citizens of the state; as committed adherents of "participa- 
tory democracy 'openness of decision-making." and the 
like. 

But what is the reality? It is a commonplace that 
every good medical school on this continent is turning 
away five, six, ten, twenty or more well-qualified appli- 
cants for every student admitted. We admit only a highly 
selected group: not to mince words, an elite. We may fairly 
suppose that many of those rejected would have found 
genuine self-realization in a career in Medicine — to say 
nothing of the fact that they are also badly needed. But ask 
the government to fund you at a level which will permit 
you to treble or quadruple your medical faculty intake, and 
the talk about universal accessibility is suddenly turned off. 
It turns out that governments arc interested in accessibility 
at a price: and that they are unwilling to pay the full price 
of universal accessibility. There are hidden or masked con- 
straints on their allegiance to "accessibility," As for open 
decision-making, one has yet to hear of the party caucus or 
the government cabinet being thrown open to the press. 
The realities of political competition simply rule that out. 
Governments, again, insist that they believe in efficiency 
and productivity — while their civil service rolls expand 
every year at astonishing rates. Yet universities are con- 
sidered fair game for all those demands we noted at the 
outset which are embedded in the popular cry for "account- 
ability." 

I am not here trying to belabour governments: right 
now, most democratic governments are struggling with a 
host of perhaps unmanageable problems and are in a case 
as sad as that of the multiversities. Faith in our institutions 
generally is badly eroded. I am merely trying to indicate 
that cant and hypocrisy are by no means the private pre- 
serve of academe. Governments also play — and of neces- 
sity — the masking game; and in our own legitimate in- 
terests and that of our institutions of higher education it is 
high time to start saying so. 

Conclusion 

Let me review and conclude. I have been arguing 
that the university is generally in poor condition to respond 
to the demand for accountability, even w hero that demand 
may be legitimate and not merely a club to beat us into sub- 



mission. For this condition there are many causes: some 
inner, some outer. One pervasive cause is that the rapid 
growth forced upon us in the decade of the sixties was too 
much for any organization to cope with. As Sir Eric Ashby 
has wisely remarked, it is the experience of a biologist that 
large mutations are invariably lethal: the same taw applies 
to social organizations. 17 

Whatever the causes, much of the substance of the 
old order has vanished. Let me now advert to Alice in 
Wonder/and and modify our text by one word only: 

"All right," said the University, and this 
time it vanished quite slowly, beginning with the 
end of the tail, and ending with the grin, which re- 
mained f.ome time after the rest of it had gone. 
Unlike the Cheshire-Cat, however, we cannot re- 
appear. 

What, then, is to be done? No short, easy answers to 
difficult problems can be expected. People who have the 
answers, one finds, usually don't have the problems. The 
simple mentality of the Queen of Hearts, for whom the 
command "Off with his head!" was the recipe In all diffi- 
cult cases, will not suffice. 

What we face is a long and difficult task of recon- 
struction. And one of the first essentials is to start talking 
with much greater candour about our present situation. As 
long as we persist in presenting ourselves to the public as 
an autonomous community of purely rational, disinterested, 
high-minded scholars, dedicated only to truth, governing 
ourselves in dispassionate and efficient fashion, we are 
going to be in trouble. The public will naturally (and 
rightly) wonder why, if that is the case, we cannot order 
our affairs in better fashion. As Warren Bennis has noted, 
all of our institutions — including the university — are 
facing an increasing credibility gap. Lack of candour, he 
suggests, fosters "the adversary culture;" and moreover 
"has a devastating impact on the effectiveness and morality 
of our institutions." 18 

Some of the outlines of the future are very dim. 
Others, 1 think, are tolerably clear. There is a well-known 
law that as society evolves, its members tend to move from 
a condition of status to one of contract. No longer can we 
talk, as philosophers of a previous generation did, about 
"my station and its duties". The movement from status to 
contract has now caught up with the university. We are at 
the end of an era; and in our reconstruction we shall 
probably have to build upon new contractual bases of 
which faculty unionization, now the focus of so much in- 
terest, may well be typical. In any event, it is quite certain 
that much of what we have known and valued is going to 
pass away, if it is not already gone. With proper leadership 
and resolution, however, we should be able to salvage 
something of the central core of our tradition and values. 

Only, however, on the condition that we examine 
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ourselves more critically and address ourselves more vigor* living, My addendum is more modest: it is also just too 
ously to repudiating outworn myth and dogma, It was dangerous. 
Socrates who said that the unexamined life is not worth 



* Alice in Wonderland, Chapter VI 

* Annuo! Report, 1972, Western Interstate Commission on Higher Education (P.O. Drawer P, Boulder, Colorado. 1973). pp. 2-3. 
» Bowen, H.R. "Holding Colleges Accountable," Chronic/o of Higher Education, Vol. VII, No. 23, (March 12, 1973), p. 28. 

* Mortimer, K.P. "Accountability in Higher Education." ERIC Clearinghouse on Education, Vol. 1, 1972, p. 47. 

> See Annan, Noel. "What arc Universities For, Anyway?" The Listener, Vol. 88, No. 2275, (November 2, 1972), pp. 597-600. 
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of participatory modes of government, see the "curriculum essay" by David K. Hart, 'Theories of Government Related to Decentralization and 
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Education). Vol. 2. No. 2, (1972). p. 10. 

» Carney, T.F. "Towards 1984." Unpublished submission specially commissioned by the Bonneau-Coriy Commission on the 
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if Nisbet, Robert. The Degrodotion of the Academic Dogmo. (New York: Basic Books, Inc., 1971), pp. 43-44 and 137-138. 

»» See Vann, Carl R. and Singer. Philip. "The University as Therapeutic Community." Chongc. Vol. 4, No. 5, (June, 1972), pp. 6 and 58-59. 

» Gardner, John. "The Antiteadershlp Vaccine," 1965 Annuo! Report* Carnegie Corporation of New York, 

" 1 owe the phrase to Professor T.F. Carney, of the Department of History. University of Manitoba. 

h For further development of the concepts, see the writer's article in Stoo, cited above. 

i* Ludwig Wittgenstein's Phi/osoph/cof /nvesligotions is a most powerful and influential exploitation of the concept of the game. In the 
field of Philosophy. For an example of the influence of Wittgenstein's treatment of games in the field of political science, see the penetrating 
and impressive study by G.T. Allison. Essence of Decision (Little. Brown and Co., Boston, 1971), particularly at the level of development of his 
third "analytic paradigm" in Chapters 5 and ff. 
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Seldom in higher education has a college or a uni- 
versity received at founding a mandate to conduct large- 
scale institutional research and to use findings for im* 
proving institutional functioning. In fact, even at existing 
colleges and universities, institutional research is often a 
low priority indeed. The new* nontraditional college of arts 
and science of the State University of New York is a not- 
able exception, for, at Empire State College, research and 
evaluation claims equal status (o the other key institutional 
functions. This paper will give an overview of Empire State 
College, discuss the rationale for institutional research, and 
outline the projected research and evaluation program. 

Overview of Empire State College 

Empire State College is to serve as an alternative to 
the traditional institutions of New York State. It represents 
a " . . .statewide commitment to test and experiment with 
new, flexible, and individualized modes of learning/' 1 Be- 
cause of this charge. Empire probably has more unusual 
features than any other single institution in the United 
States or Canada. 

Empire is a college without campus, instead, the 
institution utilizes a statewide network of mechanisms for 
reaching students. The most prominent mechanism is the 
regional teaming center which generally has a dean, an 
associate dean, an assistant dean, and thirteen to sixteen 
mentors covering a variety of disciplines, though other 
staffing patterns also exist. Currently, there are regional 
learning centers in Albany, Rochester. Manhattan, and 
Long Island (Old Westbury). By 1974-75, the College 
intends to complete statewide coverage with the addition of 
centers in the lower Hudson area, in western New York, in 
the southern tier, and in central New York. 

Regional learning centers are the primary 
administrative and academic loci for planning and ful- 
filling student programs of study. Operating year-round, 
they have responsibility for developing and extending 
various educational services throughout their entire regions. 
In doing this, centers will increasingly find it convenient to 
estabtish satellites at such locations as public and private 
colleges, museums, industrial plants, prisons, community 



centers, churches, and governmental agencies. Satellites 
help Empire State College go to the students and will be 
expanded or discontinued as student need and demand 
require. 

The overall administration of Empire State College is 
located at the Coordinating Center in Saratoga Springs. 
There the President, the Vice Presidents, and their staffs 
supervise the formulation and administration of college- 
wide academic, fiscal, personnel, and facilities policies in 
consultation with the deans and faculty. 

The idea of Empire State College requires that 
faculty seek ways to provide study opportunities in re- 
sponse to student's individualized purposes, interests, and 
needs. Furthermore, the College is to use the variety of 
learning resources that exist in the State rather than dupli- 
cate existing resources. This translates into essentially 
three modes of learning: the mentor mode, the adjunct 
mode, and the organized program mode. In the mentor 
mode, students come to the regional learning centers or 
satellites and meet face-to-face with faculty (called 
mentors). Together the mentor and student develop and Im- 
plement an individualized program of study built on a 
series of learning contracts. These programs of study may 
involve elements of the adjunct mode: field studies, tutors, 
regular courses at other colleges and universities, work 
study opportunities, internships, and the like. It also may 
involve use of organized programs which are self-study 
modules developed by the Learning Resources Faculty, a 
high-powered group of scholars recruited both nationally 
and from the regional centers and housed in Saratoga. 
These organized programs can be used by students who 
have mentors and by students who wish to work inde- 
pendently. 

Another specific element of the Empire State College 
idea is that students be granted significant amounts of 
advanced standing on the basis of prior learning. This 
learning may have come about in formal academic situa- 
tions or simply through the experiences of a lifetime. Stu- 
dents document their learning in autobiographical port- 
folios which are assessed at the regional learning centers 
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and the Coordinating Center. Currently, a student can earn 
up to five-sixth's of his degree on the basis of prior 
learning. 

Rationale for Research and Evaluation at Empire State 
College 

One of the early decisions made at Empire State was 
to have a strong internal research and evaluation program. 
Such external groups as accreditation commissions and the 
larger educational consultant firms could and may 
eventually conduct a number of useful studies. However, a 
common theme in relevant literature is that internal re- 
search programs have advantages over external research 
programs in promoting organizational change. As Burns 
and Stalker 2 and Lawrence and Losch* point out, the 
structure of organization should be contingent upon the 
nature of the organizational environment. For Empire 
State's dynamic environment, Peterson* would draw upon 
these studies and recommend an active internal research 
office to provide systematic and regular input to the de- 
cision making process. Important to this argument is the 
notion of acceptance of results. Before they will promote 
change, decision-makers must "internalize" 5 the need for it. 
Achieving this can be difficult so Bcnnis recommends that 
•\ . . the more profound and anxiety-producing the 
change, the more a collaborative and close relationship is 
required/' 6 French and Raven 7 would agree, noting "refer- 
ent-power" — identification with a person's viewpoint be- 
cause of feeling for and understanding of that person — is 
a likely outgrowth of regular interaction. Thus, as an inte- 
gral part of and a regular contributor to the decision-making 
process, the research and evaluation program at Empire 
State should play a vital part in the futire development of 
the College. 

A second reason for having a strong research and 
evaluation program at ESC is the great interest in the in- 
complete but evolving plans and programs of Empire State 
College. Students, faculty, ESC administrators, State Uni- 
versity administrators, legislators, high school guidance 
counselors, and many others across the country are asking 
important questions of the new venture: 

— What are the characteristics of students at- 
tending the College? 

— What sorts of activities do students engage in 
during their learning careers at the College? 

— What are the activities of faculty and adminis- 
trators in the College, and how do they differ 
from those of people at more traditional in- 
stitutions? 

— What are the outcomes for students and others 
who participate in the program and processes 
of the College? 

— What can be said about student and faculty 



attrition from the College? 
— What are the costs associated with this enter- 
prise and v/ith its major elements: assess- 
ment of prior learning, contracts, organized 
programs? 

The challenge in dealing with these and other simi- 
lar research matters is that the "correctness" of the answers 
depends upon the perspective of the questioner. For 
example, in reporting on the mentor-student relationship, 
mentors will want us to emphasize the teaching that goes 
on, SUNY administrators will want us to concentrate on the 
mentors' role in identifying external learning resources, 
legislators will want primarily to see evidence of what ESC 
activities cost, while students tend to cite the counseling 
aspects of this relationship. Multiple frameworks arc there- 
fore a critical part of ESC's research and evaluation 
activities. 

A third reason for institutional research relates to the 
second: the answers to the questions could have enormous 
implications for higher education, Several states, at least 
two provinces of Canada, and some OECD member 
countries have shown interest in nontraditional higher 
education ventures. If a large number of ESC students are 
notably different from those at "normal" institutions, we 
could see many Empire States in the next-few years. If the 
educational activities of ESC students and faculty prove ef- 
fective, we might see their adoption in some form at exist- 
ing colleges and universities. This will almost certainly 
happen if the cost of these alternative modes of learning is 
less than traditional modes. An institutional research pro- 
gram systematically reporting results can facilitate or, if ap- 
propriate, red-flag such happenings in other places. 

Initial Research Strategy at Empire State College 

The nontraditional nature of Empire State College 
calls for a nontraditional research and evaluation program. 
Needed is a flexible research strategy which utilizes proven 
methodologies of institutional research in combination with 
appropriate new ideas. Our immediate approach began 
with four major activities that have immediate administra- 
tive usefulness and that begin to answer to major questions 
facing the institution. 

1. Design and Develop Computerized Information Files 
on Students, Personnel, Finances, and Learning Re- 
sources 

The geographic dispersion oi the College neces- 
sitates the early placement of vis Ja! display computer 
terminals in the various regior cl centers to allow 
remote input and output. The network will be useful 
for maintaining up to-date records on students and for 
keeping the College from becoming buried in paper. 
The learning resources file will be especially useful for 
providing rapid dissemination of knowledge about 
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Table 1 

PERSPECTIVES OF EMPIRE STATE COLLEGE 



STUDENT 
PERSPECTIVE 



MENTOR 
PERSPECTIVE 



Program 
of Study 



Advanced 
Standing 




Learning 
Resources 



Contract Evaluations 



Contracts 



Student. 




Mentor 



EXTERNAL 
PERSPECTIVE 

(accreditation 
commission!, 
legislator, 
general public, 
Bureau of 
Budget, higher 
edoc • 
community) 



INSTITUTIONAL 
PERSPECTIVE 

(ilated institu- 
tional goafs it 
objectives, lop* 
level adminls- 
tratori goals & 
objectives, 
faculty goafs & 
objective!) 
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available learning resources. For example, the student 
interested in studying the welfare system will be able to 
receive instantaneous information about references and 
libraries Where they are available, internship possi- 
bilities, lists of knowledgeable people in the com- 
munity, etc. 

2. Laimch Case Studies of "Finishers" — Persons Recently 
Graduated from the College 

This project, which involved intensive in- 
terviews with ten of the first 30 graduates of ESC and 
their mentors, was recently completed. 6 From it, the 
College learned of some areas that need attention and the 
research and evaluation staff learned where to focus 
some future research efforts. 

3. Underlake a Cosl/Effeclive ness Study 

This three-year project, recently funded, is the 
framework into which all other studies will now fall. 
We currently Intend to utilize standardized cognitive 
and personality instruments in conjunction with content 
analysis of student learning contract products (e.g. 
papers), journals and interviews in an unusual rolling 
longitudinal design (see Table 2). 

The year-round calendar of the College which 
allows students to enter throughout the year necessi- 
tates this design which has several starting points and 
several ending points. Some advantages of a rolling 
longitudinal study include: (1) it is more representative 
of continuing patterns than a normal longitudinal design 



because data is collected over several months at each 
administration; (2) it is more reliable than a normal 
longitudinal study because tho retestings can serve as a 
control; (3) like any longitudinal study, it allows the re- 
searcher to follow changes in individuals; (4) the inter- 
view component increases the likelihood of picking up 
affective environmental factors; (5) the design allows 
the researchers to have a large sample without burying 
themselves at any given time; (6) the test-retest aspect 
allows early feedback to the College; (7) the longitudi- 
nal sample can be used for other studies. 

4. Conduct Participant Research at the Regional Learning 
Centers 

The focus of this project was the faculty mentor; 
What are the mentors' characteristics, activities, prob- 
lems, anxieties, and ambitions? To find out, we joined 
the regional center staffs for a period of time and es- 
sentially became mentors. The study also involved 
questionnaires and interviews. An additional major 
hope was that through the unusual participant 
methodology, the research and evaluation staff would 
develop a regional center perspective to go along with 
the inherent Coordinating Center perspective. 

Summary 

Institutional research has seldom been an imperative 
in higher education, However, at Empire State College, a 
desire for immediate decision-making information, the 



Table 2 

ROLLING LONGITUDINAL DESIGN 



Month 

Sample 1 2 3... 18 19 20.- 30 31 32 



Initial 
Tests and 
Interviews 



Initial 
Tests and 
Interviews 



First 

Re tests and 
Interviews 



first 

Retests and 
Interviews 



Second 
Retests and 
Interviews 



Second 
Retests and 
Interviews 




Initial 
Tests and 
Interviews 



First 

Retests and 
Interviews 



Second 
Retests and 
Interviews 
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amount and breadth of Interest expressed in the institution, College, The initial research strategy is to launch studies 
and the tremendous potential implications of findings make with immediate utility but which also begin to answer the 
institutional research an integral part of the developing major questions facing Empire State College, 
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INSTITUTIONAL RESEARCH AND THE EXTERNAL ENVIRONMENT: 
AN APPROACH TO CONTEXTUAL ASSESSMENT 



Paul R. Lyons, Frostburg State College 



At the first general session of the 1972 Annual Forum 
of the Association for Institutional Research, Warren 
Bennis took time to reminisce about his experiences as 
Academic Vice-President at S.U.N.Y. — Buffalo. As his 
address drev/ to a close Dr. Bennis directed a few 
' pointers'* toward present and future college and university 
leaders. One such pointer he mentioned had to do with 
knowing one's territory, one's community; that Is, knowing 
how the institution fits the community, how the institution 
is perceived within the community and how the institution 
serves and is served by the community in which it is 
located, Two days later, on Wednesday, Harold Hodgkin 
son admonished us for being reductionists, that is, for al- 
lowing our vision to become clouded so that we think in 
terms of components and not wholes. His argument was 
very similar to the one about the forest vs. the trees. The 
message contained in these remarks of the two speakers 
serves as the introduction for this presentation. 

It has always been of extreme importance for college 
and university leaders to have some knowledge of their 
institution's place in the environment. The words "college 
community" more often than not refer to the community of 
scholars, students and supportive staff. The College Com- 
munity is seen as ah entity, one with boundaries of varying 
degrees of permeability and fluidity. Today, with public 
disenchantment focused toward higher education, it would 
appear that institutional leaders have a greater than ever 
need to assess and take cognizance of community percep- 
tions of and attitudes toward the college or university. The 
term community must be regarded in the broad sense. For 
some institutions, community can mean the world; for 
others it can mean a continent or a nation; for others, and 
this include* most institutions, community can mean a 
state, a region, a city or a town. In post-secondary education 
we need to take a broader view than in the past. We need to 
know more about how we are perceived and how we are 
informally evaluated. One need only briefly scan the 
literature of higher education before it is quickly revealed 
that colleges and universities have not taken the time nor 
the effort to comprehensively examine their environments. 
A few institutions have done extensive work along these 
lines primarily in the areas of institutional financial impact 
on the region, space planning, program planning, 



enrollment forecasting, manpower needs and the like. Only 
a handful of colleges and universities have systematically 
sought to comprehensively study and examine the institu- 
tion as it is perceived in the field, in the communities. You 
may be aware of the excellent bibliographies developed by 
the Council of Planning Libraries. This organization has 
compiled perhaps the best contemporary accounting of 
work completed in the area of general campus community 
relations. 

We are wont to make a great deal of assumptions 
regarding how the institution is perceived, should be per- 
ceived or might be perceived. In the absence of any system- 
atically sought-but data such assumptions are relegated to 
the status of good, bad or mediocre guesses. Most of these 
assumptions are based upon communication with either 
friends or enemies of the institution in question. This type 
of friendly/hostile informal evaluation can, at times, have a 
vast impact on institutional decision-makers, especially 
those who do not have some form of objective evidence to 
rely upon. Institutional researchers, by design or inclin- 
ation, have not begun to scratch the surface of the research- 
able domain of community attitudes, perceptions and 
knowledge. 

The assessment of community attitudes and percep- 
tions is but one small piece of the ever-changing contextual 
mosaic of the institutional environment. In a dynamic 
society such as ours, one marked by social pluralism, the 
mosaic as a representation of reality can never be 
completed as the perspective is never fixed over time. The 
concep: of contextual assessment must of necessity, be a 
flexiable, fluid one. This is how contextual assessment is 
value'] at Frostburg State College, where the Office of Insti- 
tutional Research has systematically sought to actualize the 
concept of contextual assessment, that is, the on-going con- 
tinual assessment of the institution's environment. The 
contextual or environment assessment approach is 
essentially a way of identifying the particular elements of 
an institution's environment and setting about to assess 
various characteristics of those elements in relation to the 
institution. The elements of the environment for a given 
institution might include (besides faculty, students, and 
support staff) parents, high school students, the immediate 
community, the military, the state legislature, the alumni, 
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and so on. 

At Frostburg State, a period of approximately 18 
months saw the identification of several environmental 
elements along with attempts toward assessment of each 
element. These elements were: 

Alumni 

Entering Freshmen (prior to attending classes) 
Faculty 

Administrative Staff 
Students ("natives") 

Community Residents — Genera! Population 
Community Residents — Positional Leaders 
Transfer Students 
Currently underway is a project which will involve all 
elements of or a sample of the last six groups represented 
above. 

The contextual approach to as3essment, like an 
annual giving campaign or an elaborate, multi-faceted 
management information system takes time to develop, 
cultivate, test, and evaluate. At Frostburg State we have a 
beginning, a frame of reference has been established. Due 
to staffing and financial constraints the beginning has been 
slow and sometimes painful. Thanks to instruments such as 
the C.U.E.S., I.F.I., LG.I., the task has been made manage- 
able. Perhaps the most significant virtue of the contextual 
approach is that the assessments of various element char- 
acteristics can be incorporated into the "whole 11 to give a 
more comprehensive picture to the viewer. This can be 
especially valuable if the basic elements of the environ- 
ment (students, faculty, staff) are continually being 
assessed with regard to program and institutional govern- 
ance, aspirations, satisfaction, future orientation and the 
like. What we are, where are we going can be brought into 
much sharper focus if one can take into account those 
elements of the environment which impact upon the insti- 
tution. Contextual assessment, then, assists with both 
evaluation and planning. This approach is in direct contra- 
diction of the modus operandi of the reductionist. 

The Frostburg State College Survey 

Assessment of community knowledge of the college 
and assessment of perceptions and attitudes held 
concerning the college were the major areas of inquiry with 
which the survey dealt. It must be pointed out that the 
survey was regarded as a pilot project, one that was to be 
refined, polished and periodically replicated. Early in the 
project the decision was made to include different survey 
populations. First, a random sample of community resi- 
dents (general population) was to be contacted. Second, an 
attempt was to be made to contact positional leaders 
(mayors, councilmen, county commissioners, business and 
voluntary association leaders, and the like). As one goal of 
the project was to supply information for decision-making, 
it was felt that data provided by such an "elite" sample 



would be at least as valuable as that provided by the 
general population. In no instance was the sample of 
"elites" assumed to be representative of a regional or com- 
munity power structure although it is conceivable that 
members of this sample may have been members of the 
community power structure, Due to the fact that this pilot 
project started "from scratch," survey Instrument 
development was the most costly aspect of the project with 
regard to time Invested. The survey instrument or interview 
guide was a document of 25 items (some being fixed-choice 
response types, others open-ended) was titled the Survey of 
Community Attitudes and Perceptions (SCAP). The input 
was provided by the college president and his administra- 
tive council (academic affairs, student affairs, business 
affarls) and the public relations director. The individuals 
concerned arrived at a set of questions which they believed 
addressed themselves to the major areas of shared and 
Individual inquiry. The SCAP was revised three times via 
the consensual approach before reaching its final form. In 
order to have some basis for comparison among Institu- 
tional and extra-institutional samples, 8 items (questions) 
taken from the "Meeting Local Needs" scale of the Institu- 
tional Functioning Inventory ( I F I ) were included in the 25 
items. The IF], as developed by the Educational Testing 
Service, Princeton, New Jersey, provides a means by which 
a college or university can describe itself in terms of a 
number of characteristics judged to be of importance in 
American higher education. Consisting of 132 multiple- 
choice items, the 1FI yields scores on 11 dimensions or 
scales, each comprised of 12 items. One such scale, 
"Meeting Local Needs, "is comprised of primarily informa- 
tional items. Since nearly all faculty and administrative 
staff had recently been subjected to the 1FI, it was decided 
that the survey populations be subjected to some if not all 
of the items comprising this scale. Their responses would 
allow for comparison between the survey population and a 
supposedly highly knowledgeable population (faculty and 
staff) with regard to the college. Eight of the 11 Items 
contained sufficient generality to be included In the survey 
instrument (SCAP), 

Clear criteria for defining the "community" in which 
the College exists were hard to come by, and any of several 
methods suggested by sociological community study guides 
and texts could have been used, but each was arbitrary and 
each would have led to different boundaries. Limits were 
chosen that were no less arbitrary (yet, hopefully, no less 
valuable) than those suggested in the literature: it was 
assumed that college/community attitudes and perceptions 
would diminish in Intensity and accuracy, respectively, 
with socio-geographic distance from the institution, and 
chosen as a measure of that distance was the pattern of 
residence of College employees. It was assumed that 
employee commuting distance was a fair measure of the 
College's area of immediate influence. Due to local 



ERLC 



Paul R, Lyons 



geography, radio station signals and local newspaper 
delivery have about the same degree of dispersion in terms 
of area. An inventory of the College Direclory was made lo 
determine the distribution of employees* residences In the 
area. Employees' residences were distribuled across 15 
towns and communities. An unslratlfled random sample of 
residents drawn proportionately (based on employee distri- 
bution) from these 15 areas was identified (from telephone 
and utility company listings). The size of the sample was 
based entirely upon convenience and manageability. Of 
62.000 inhabitants in the areas selected represented by 
13,426 households, the total sample population of 234 
represents approximately 2% of these households. Sample 
size had to be kept small since person-to-person interviews 
were to be the means by which the data was gathered with 
the SCAP instrument. That is, the general population sub- 
sample (Nw 199) was interviewed while the "elites" (N = 35. 
a 70% return) received the instrument through the mail. 
Trained, although not greatly experienced, interviewers 
conducted the interviews of the general population over a 
three-week period. Press releases were issued to legitimize 
the survey and interviewers carried identification which 
clarified the purpose of the personal contact. 

Independent variables 

Four independent variables were selected for close 
examination. While each variable was not examined across 
all SCAP items, each variable was examined on several 
items. All individuals surveyed were asked a series of 
opening general questions which woul^ enable the 
researcher to "type" the respondent in the different dimen- 
sions or variables. These variables were: 

A. Local - Cosmopolitan Orientation 

B. Proximity to Campus (Frostburg residents only — 
"typed" accoiding to address) Persons in the sub-sample 
from Frostburg (where the College is located) were sub- 
divided into four categories based upon how close they 
lived to the campus and to areas of student living or 
walking on a regular basis to the campus. The four "resi- 
dential area zones" were designated as having (1) 
"immediate proximity to campus," (2) "moderate close- 
ness to campus," (3) "moderate distance from campus," 
and (4) "distant from campus." Some differences were 
expected to emerge among the attitudes and perceptions 
of the sub-samples in each residential area. 

C. Population (General population/"Elites") 

D. ^Length of Residence in Area (Long/Short term) 
Those independent variables that were examined with 
regard to a given item were examined through the use of 
the Chi Square (X J ) technique. 

SCAP Interview Instrument 

The content of the SCAP instrument areas of inquiry 
can be outlined as follows: 



A. General Information (concerning the respondent) 
These items served to establish the respondent's 
"typing" for the independent variables. 

1. Length of Residence in Community 

2. Local — Cosmopolitan Orientation 

3. Level of Education 

B. Information Sources and Opinion 

1. Sources of Information Concerning the College 

2. Typology of Information Sources 

3. Nature of Information 

4. Perceived Opinions about the College 

C. Assessment of Factual Knowledge Regarding the 
College 

1. Major Differences between the College and Neigh- 
boring Community College 

2. Student Population 

a. Size of student body 

b, Permanent residence of students 

3. Curricular Offerings 

a. Programs offered 

b. Future program offerings 

4. Faculty and Staff 

D. Assessment of Attitudes and Perceptions Regar- 
ding the College and its Future 

1. Economic Impact on Frostburg 

2. Economic Impact on Area 

3. Recent Growth Rate ("growth" undefined) 

4. Future Rate of Growth 

E. Attendance at College Events 

1. Attendance Patterns in General 

2. Attendance Patterns at the College 

3. Distribution of Attendance across Types of Col- 
lege Events 

F. Student/Community Relations 

1. Frequence of Contact with Students 

2. Keyword-Descriptions of "Typical" Student 

3. Major problem areas 

G. "Meeting Local Needs" Scale of the Institutional 
Functioning Inventory 

Responses to these eight items were most revealing 
In that the item content reflected knowledge of College 
services, practices, policy and philosophy and compar- 
isons could be made across samples of the general 
population (total sample), "elites, 0 faculty, administra- 
tive staff, and Frostburg residents. Wide discrepancies 
between response patterns of community residents and 
college personnel were particularly revealing. 

In general, the results indicated that the General 
Population is not aware of the nature of services 
the College is providing or is able to provide. Lack 
of knowledge characterized the General Population 
sub-sample. The Elite sub-sample gave a much higher 
proportion of "committed" responses (Yes-No) to ques- 
tions but were highly, almost overly, positive. Faculty 
and staff, who have more knowledge regarding College 
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functions and services, had similar response 
patterns although staff members were consistently 
more positive with regard to community access to 
services and functions. 

Summary of Testa of Hypotheses (A-F) 

Briefly stated, It was a concern of the researchers to 
determine which of the independent variables treated in 
the foregoing sections had value in terms of identifying 
specific college "publics" each having specific or particular 
response patterns with reference to dependent variables, 



Table 1, below, presents the distribution of tests of 
statistical association over independent variables 
dichotomized into significant and non-significant 
outcomes. 

Results indicate that one-sixth (1/6) or about 17% of 
all tests were significant at the .05 level. Proximity and 
General Population-Elite variables had a much lower 
demonstration of statistical association with dependent 
variables than did Cosmopolitan-Local', Length of Resi- 
dence variables. 

From the point of view of decision-making with an 



Table 1 

DISTRIBUTION OF OUTCOME 
— TESTS OF SIGNIFICANCE — 



Independent 
Variables 



Outcomes 



Non-Significant 
N | % of Tests 



N 



Significant 
I % of Tests 



Cosmopolitan-Local 7 

Proximity 7 

Gen. Pop.— Elite 13 

l ength of Residence 3 



70 
100 
93 
60 



1 
2 



30 

7 
40 



Total Tests 30 

% £>f all Tests 83% 



eye to the future and to various college publics, this 
funding presents a problem; it is far easier to identify 
persons according to Proximity and/or inclusion in the 
General Population or Elite (positional leaders) samples, 
but these groupings, unfortunately, do not demonstrate 
statistical linkages with independent variables. On the 
other hand, Cosmopolitan-Local orientation and Length of 
Residence variables represented by population elements 
are much more difficult to identify yet a higher degree of 
statistical association is eveident with regard to particular 
dependent variables. 

Because the results in terms of total number of tests 
of significance are somewhat dependent upon the parti- 
cular matching of independent*dependent variables for 
testing, it seems reasonable to conclude that no real 
patterns of association are discernible from the present 
data. Subsequent follow-up studies will hopefully, develop 



6 

17% 

I 



more sophisticated means of identifying specific "publics/' 

Survey Results and Their Application 

While reporting specific findings is perhaps 
inappropriate for this presentation, some indication of how 
the survey results were applied at the College may be 
meaningful for researchers. What follows represents some 
of the effects the survey has had on the "College 
community/' 

1. Enhanced Awareness and Knowledge of Top-Level 
Decision-Makers 

Although the instrument was not sophisticated, a 
great deal of information was gathered which, hereto- 
fore, was unavailable* Some commonly held stereo- 
types regarding the community were shattered and the 
available information made it possible for one to 
visualize how the "typical" community resident views 
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the College, In addition, information was available 
indicating what some of the future directions of the 
College might be. 

2. Public Relations/Information Services Re-Evaluatlon 

Since the results of the survey were made avail- 
able in May of 1972, the Public Relations staff at the 
College has initiated a series of activities to more 
adequately project what the College is and is not and, 
more importantly, the approach taken in Informing the 
public has been changed dramatically. 

3. Survey Report as "Required Reading** in Some Depart- 
ments 

Some administrative and academic unit personnel 
were asked to closely examine the content of the 
survey analysis with the expectation that said content 
would be of value in evaluation and planning types of 
activities. 

4. Long-Range Planning 

As the College will continue to assess many 
environmental elements, the community survey (or a 
similar type of assessment) will remain as one of the 
major or basic elements for gathering information. 
Survey results have been useful in the long-range plan- 
ning effort of the public relations / information 
services staff, the results are being scrutinized by an 
ad hoc committee which is setting goats (long-range) 
for the Co 'ege's graduate program, and they have 
served as reference material for the College's academic 
planning group (undergraduate program). 



A study currently underway at the College Is 
making use of the Institutional Goals Inventory (l.G.I.) 
developed by the Educational Testing Service. 
Different college constituencies (and external groups) 
are queried by the l.G.I. instrument to seek to establish 
the importance of both process and output goals. A 
community sample has been selected for Inclusion in 
this study with the anticipation that not only will 
community residents' responses be valuable for the 
current purposes of the investigation but that their 
responses may serve to test the reliability of the 
previous community survey. 
6. Follow-up 

There were enough "surprises" contained In the 
results of the survey to warrant further and different 
types of inquiry. In addition, these same results have 
helped to create a more open, inquisitive attitude on 
the part of College officials With respect to what is "out 
there." 

In brief summary it can be said that the O.I.R. at 
Frostburg has sought to "know the territory" as Warren 
Bennis had suggested. It is believed that any college or 
university that makes an attempt to develop information 
about their community or sphere of influence will be light- 
years ahead of those who are content to play guessing 
gaWs and who are confident that they "know" what 
peopte^think. Without systematic assessment and inquiry it 
is easy to "feel" but not to know. 
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PLANNING MODELS IN HIGHER EDUCATION: 
A COMPARISON OF CAMPUS AND RRPM 1 




Over the past decade, higher education has experi- 
enced a painful transition, from a growth period in which 
post-secondary education enrollments more than doubled 
in size, a wave of traumatic student unrest and rebellion, 
and, now, a phase of consolidation and retrenchment — a 
period of sober re-evaluation of the purposes and content 
of higher education. 

The difficulties of the past decade have given rise to 
a massive urge to apply the contemporary technologies of 
management science, operations research, modeling, and 
systematic decision theory to the planning and manage- 
ment processes of colleges and universities. The attempt to 
apply rational economic models to the complex political 
systems of governmental and social institutions has fallen 
far short of demonstrable success in relation to our hopes 
and expectations. Nevertheless, the search persists for more 
effective ways of utilizing the resources of higher educa- 
tion. 

Large-scale computer models are one manifestation 
of the "managerial revolution" in higher education. In a 
1970 survey by Weathersby and Weinstein, 31 higher 
education models were identified and compared, 3 Among 
these, eight were comprehensive institutional models but 
only two were then operational — CAMPUS and the Uni- 
versity of California Cost Simulation Model (CSM).< Since 
then several other model systems have become operational. 
These are: RRPM. CAMPUSJHEALTH {a special version of 
CAMPUS for medical schools), and the TULANE model. A 
set of related modeling systems are CAP:SC/SEARCH and 
HELP/PLANTRAN. The former is designed primarily for 
small liberal arts colleges, while the latter is mainly a 
budget simulator. There are a number of models being de- 
veloped for a particular institution, such as RCN and 
FACSIM, specialized models for the Air Force Academy. 

However, for the many institutions of higher 
education that cannot develop models of their own and are 
seeking a generalized and comprehensive model, there are 
two that have attracted greatest attention: RRPM. the most 
accessible and commonly used; and CAMPUS, the most de- 
tailed and comprehensive. These two models are the 
subject of this paper. 

After a brief historical review of the models, discus- 
sion will cover the basic structure of the models; common 
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elements and differences between them; their implementa- 
tion and use; and finally, some comments on some de- 
sirable features for their further development, 

HISTORICAL DEVELOPMENT 

CAMPUS is an acronym for "Comprehensive Analy- 
tical Methods of Planning in University Sustems." It has its 
origin in the work on simulation in higher education done 
by |udy and Levine. 5 They developed and now market 
CAMPUS through the firm, the Systems Research Group 
(SRG) based in Toronto. Judy and Levine developed CAM- 
PUS V* under a grant of $750,000 from the Ford Founda- 
tion, which was placed in the public domain in 1970. 

CAMPUS V was hardly used. It was inadequately 
documented and very costly — both development and 
operational costs. The development costs were high 
because of the large mass of data required by the model, 
including resource data on each activity — a set or subset 
of a course that requires a unique set of types of ^sources. 
These were used for computations done mostly one inte- 
grated main program that ted to high operating costs, es- 
pecially when answering "What if questions in the simul- 
ation mode. Also, most of the data had to be kept in resi- 
dent core requiring a very large computer. For the Uni- 
versity of Illinois, this was estimated at 4 million bytes, 
recently reduced to 300.000 bytes as a result of much repro- 
gramming. Thus CAMPUS V was beyond the reach of 
almost all institutions except the large and the daring. 
These included the State University of New York at Stony 
Brook and the University of Illinois. The State of Minnesota 
also implemented CAMPUS V on a pilot basis (in one 
school of a univeristy, one state college and one junior 
college). 7 Despite its limited use, CAMPUS V did perform 
an important service to higher education. It demonstrated 
the feasibility of a comprehensive cost simulation model 
that could improve decision-making in planning and 
budgeting. What was needed, however, was a model that 
made more modest demands on data, equipment, and 
analytical effort so that it could be within the reach of most 
institutions of higher education. 

To achieve such an objective* the U.S. Office of 
Education funded a proposal for model development by the 
National Center of Higher Education Management Systems 
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(NCHBMS) at the Western Interstate Commission for 
Higher Education. This product is known as RRPM-1 — Re- 
source Requirements Prediction Model. 

RRPM 1.2 y/as the first operational version. It was a 
modification of the California CSM* made by the staff of 
NCHEMS and a national task force. It was implemented by 
eight pilot institutions selected to represent the different 
i types and sizes of institutions in the country. As a result of 
the pilot testing.fuither modifications were made and 
RRPM 1.3 was released in mid-1971 9 . 

Since RRPM 1.3 was a generalized model, other 
specialized versions were planned. Versions 4 10 and 5 were 
to be specialized for the community colleges and the state 
colleges respectively. But instead a sixth version, RRPM 1.6 
was released. This involved reprogramming and rearrang- 
ing of input data by discipline rather than function. This 
decreased core requirements (along with the fact that it 
stores only non-zero data) in spite of the relaxation of con- 
straints on the dimensions of student programs and dis- 
ciplines. This made its use independent of the type of insti- 
tution using it. It is also conceptually simpler than RRPM 
1.3 because it has no space-management module and has 
fewer relationships for support costs. It was implemented 
in 1972" and has now been released to the public. Both 
versions 1.3 and 1.6 are now operational, but only 1.3 is 
being maintained by NCHEMS. 

Meanwhile CAMPUS underwent considerable 
changes. It was completely reprogrammed as CAMPUS VI 
and was made modular. This greatly reduced its opera- 
tional costs and core requirements. But data are still re- 
quired at the activity level. However, the input formats 
were changed and documentation was greatly improved 
making data preparation much easier. CAMPUS VI was re- 
programmed as CAMPUS/COLORADO and « CAMPUS 
VII, making them more modular, more flexible in their di- 
mensions, with additions in the costing routines, and a 
better handling of the research s ector. 

In addition. CAMPUS VII was developed." This 
version does not require data at the activity level and hence 
has further reduced core requirements and operational 
costs. It is designed for institutions requiring data only at 
the aggravated level of department or above. 

In summary, there are two operational versions of 
each family of models worth examining: Versions 1.3 and 
1.6 for RRPM; and Versions VII and VIII for CAMPUS. But 
RRPM 1.3 and CAMPUS VIII are conceptually the more 
comprehensive of their family of models and as such will 
be the basis of most of the discussion that will follow. Dif- 
ferences in the other operational models, when significant, 
will be so identified, 

Basic Logic 

The basic logic common to both RRPM 1.3 and 
CAMPUS VIII is shown in Figure 1," There are many 



minor differences that do not appear in Figure 1 and have 
been deleted in order to keep the figure simple. An 
example is the computation of instructional load. In RRPM, 
this is calculated in credit hours and is then converted to 
contact hours by a ratio of contact hours to credit hours. 
This conversion is not required in CAMPUS which has all 
its activity loadings expressed in contact hours. It is also 
unnecessary In RRPM if the student loading is done in con- 
tact hours (o start with. There are many other sach minor 
differences that will not be discussed. There are, however, 
two main differences in the logic of RRPM and CAMPUS. 
They concern the level of detail in instructional loading as 
well as in planning faclors. These will be discussed in turn. 

The instructional loading In RRPM is done through 
an induced course load matrix (ICLM). In this matrix, each 
column represents the credit hour load induced by a 
student major (at different levels of academic achievement) 
on different levels of courses that are offered by different 
disciplines. In CAMPUS, the load induced is not in terms 
of aggregated levels of courses (as in RRPM), but in terms 
of specific courses or activities. Examples of activities 
would be a course with two weekly contact hours of lecture 
and one weekly contact hour of lab (or recitation). Since 
they require different types of resources (personnel and 
space), the lecture and lab arc separate activities. The de- 
tailed level of activity does generate a variety of reports that 
can be very valuable, especially in costing which will be 
discussed later. It also enables planning at the most 
elemental academic organizational level and involves all 
organizational levels in the planning process. However, 
there is a price that must be paid: the massive detailed data 
input required at the activity level. 

In the case of the University of Colorado, there are 
over 2,000 activities and for each activity up to 16 data ele- 
ments on resource loading have to be specified. These data 
must be collected (typically on forms) converted to 
machine-readable form, stored, processed, and maintained. 
The maintenance cost (especially on the mix of activities 
required for each student program) could be high for in- 
stitutions where student preferences change or where 
course requirements change significantly. It is difficult to 
predict in cases of new student programs and degrees. It is 
even difficult to specify the activity mix in order to main- 
tain status quo. This is due to the fact that the student toad 
and activity mix varies not only between semesters but also 
among types of programs such as daytime and evening pro- 
grams. The mix can be unstable even at the aggregated 
level of the ICLM, as was experienced by the pilot institu- 
tions of RRPM 1.3" and other ICLM studies, 16 These studies 
show that the greater the disaggregation of the ICLM, the 
more the instability, This instability will increase as 
students demand and get more electives and unstructured 
degree requirements. This will increase the problems of 
predicting new course mixes and the redistribution of old 
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Table 1 

SOME PLANNING FACTORS IN RRPM AND CAMPUS 





CAMPUS VIII 


RRPM 13 


INSTRUCTIONAL 






• Student programs 


• by detailed course 
activity mix 


• by mix of credit hours 
in department/discipline 




• resource loading 
of each activity 

• space 

• personnel type 

• time of offering 

• section size 

• average 

• maximum 

• minimum 

• maximum number of 
sections 


• loading of groups of 
courses at different 
levels and fields 

• space 

• equipment 

• section size 

• average 


• Faculty 


• substitution policy 

• contract length 

• turnover rates and 
hiring policy 

• sabbatical policy 

• weekly availability 

• promotion policy 

• average salaries 
by rank 

• rank distribution 

• academic level 

• workload weights 

• administrative load 


• average salaries by 
rank 

• rank distribution 

• academic level 


SPACE 


• substitution 
policies 

• availability 

• utilization 

• type 

• size 

• construction 
coefficients 


(not in RRPM 1.6) 

• availability 

• type 

• size 

• construction 
coefficients 
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ones thai are dropped. 

The detailed level of data required by CAMPUS 
occurs throughout the model and is reflected in the 
planning variables. As an example, consider the determina- 
tion of the number of sections required. In both the RRPM 
and CAMPUS, the number of sections is determined by 
dividing the student load by the average section size and 
Using some rule for accounting for the leftovers. In 
CAMPUS, however, the solution is subject to many con- 
straints such as maximum class size, minimum class size, 
and maximum number of sections. This adds to the control 
and flexibility that the user has, but it requires that all 
these constraints be specified as planning Variables (one set 
for each activity). 

For some institutions this choice of planning vari- 
ables is often unnecessary, and this has been recognized in 
RRPM 1.6 where the faculty FTE can be calculated by an 
option that uses a weekly credit-hour (or contact-hour) load 
by level of course, thereby eliminating the planning factors 
of average section size, credit to contact-hour ratio, distribu- 
tion of contact hours, distribution of faculty rank, and aver- 
age faculty work load by rank. 

There are other planning factor differences between . 
RRPM and CAMPUS. These are listed in Table 1. One set 
found in CAMPUS alone enables the "flowing" of faculty 
between time periods, using rates of turn-over, sabbatical, 
and promotion policies, contract lengths, and availability 
periods. CAMPUS maintains a faculty inventory for each 
time period. It also allows for substitutions among ranks 
within a cost center but not any substitution among disci- 
pline specialities within ranks. 

There are three parts of the CAMPUS VIII model 
other than those shown in Figure 1. One part is a Student 
Flow module that goes in front; one part calculates non- 
teaching-salary costs; and a third part is a costing module. 
Each will now be discussed. 

The Student Flow Module 

This module determines the student enrollment in 
each student program at each level of student academic 
achievement (freshman, sophomore, etc.). It is part of the 
CAMPUS VIII package and determines the flow of students 
through the system by using pass-fail rates at each level, 
repeat rates at the same level, drop out rates at all levels, 
and transfer rates between programs. This is conceptually 
similar to the Student Flow Model developed by NCHEMS 
that is designed to interface with RRPM." Following the 
NCHEMS tradition this model was developed by its staff 
supported by a national task force, tested at selected pilot 
institutions and implemented successfully. 18 

The NCHEMS student flow model and the one in 
CAMPUS Vlll have much in common: both can be by- 
passed if desiied; both use data on freshmen enrollment 
and transfers as exogenous variables; and finally, both have 
problems and issues raised by using the transition matrix. 
Some of these issues include: the definition of points and 



student states most suitable for the transition matrix; the 
calculation, aggregation and stability of transitional 
probabilities; and the validity of the Markovian assumption 
for student transitions. These issues are part of the ongoing 
research and development work being done at NCHEMS. 

Non-Salary Costs 

Non-salary costs are calculated in both RRPM 1.3 
and CAMPUS Vlll at the cost center level. This require? the 
estimation of both the relationship and the cost coefficients 
at the cost center level. This is no trivial task. In the Univer- 
sity of Colorado, implementation of CAMPUS requires 
stating 2,800 equations and estimating cost coefficients. 
Over 43 Variables are used in these relationships, most of 
them being endogenously determined. (CAMPUS Vlll 
allows up to 130 such variables, and 13,000 equations.) 

Costing 

Both CAMPUS and RRPM calculate costs for aca- 
demic and support program and subprogram levels of the 
NCHEMS Program Classification Structure. In addition, in 
CAMPUS Vlll, the costs are aggregated by budget function 
and object category. This facilitates preparing annual line- 
item budgets for financial control needed in addition to 
program budgets for analysis and decision making. 

Both CAMPUS and RRPM calculate unit costs for 
student programs by contact hour, credit hour and FTE for 
different levels of aggregaiion. In addition, CAMPUS calcu- 
lates the direct cost for each activity. This is aggregated for 
each activity in the activity mix of each student program 
and gives annual student program costs. In RRPM, the 
student program cost is determined as the inner-product of 
average cost per student credit hour by discipline trans- 
posed back through the ICLM to student program. The 
average cost figure, however, uay result in student pro- 
grams using less than average cost courses in the discipline 
being overpriced and programs using higher than average 
costs being underpriced. This possibility does not occur in 
CAMPUS because of its detailed activity level costing data. 

Indirect costs are allocated to primary programs (In- 
struction, Research and Public Service) in both CAMPUS 
and RRPM 1.3 hut not in RRPM 1.6 because this is to be 
done in the Cost Finding Principles Program of NCHEMS. 11 
It has software that will allocate support costs to primary 
programs and can be used as a costing module inde- 
pendently or in conjunction with RRPM. 20 The project soft- 
ware could also be used in a simulation mode to experi- 
ment with parameters of allocations. Once the parameters 
are selected they can then be used for allocation in RRPM 
1.3 or 1.6. In CAMPUS, there are plans for options as to 
some allocation rules: by a specified percentage; in propor- 
tion to the direct cost of the receiving categories: or a 
con.^inntion of those two rules. 

The Cost-Finding Principles project is al*j expected 
to suggest procedures for cost exchange arnon^ institutions, 
another of NCHEMS projects." 
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Cost allocation raises numerous problems including 
one of allocating faculty effort belween instruction, ad- 
ministration, research, and public service. Should this 
allocation be done by assignment or by actual effort distri- 
bution? If the latter, how is faculty effort to be measured? 
This problem has been a concern of institutional research* 
ers for over a decade and has not resulted in much agree- 
ment. For example, in measuring faculty effort, 24 studies 
measured hours spent weekly, while 16 used percentage 
distribution of time, and four studies used both. 22 This 
problem and related ones, arc the subject of yet another 



NCHEMS project: The Faculty Activity Analysis." 

Differences between RRPM and CAMPUS 

Many differences between RRPM and CAMPUS 
have been identified above. Other differences are in the di« 
mensions of tho model. These are shown In Table 2. Some 
differences of a technical nature are listed in Table 3, Other 
main differences concern the revenue module, capital 
budget, output reports, and implementation considerations. 
These arc discussed below: 



Table 2 

A COMPARISON OF DIMENSIONS* 



Student Programs 

Academic Disciplines 
or Departments (Teaching 
Cost Centers) 

Nonacademic Department! 
(Nonteachlng Cost Centers) 

Activities 

Course Levels 



Instruction Type 

Student Levels 

Faculty Ranks 

Nonacademic Raik$ 
or Classifications 

Space Type and Size Ranges 

• academic 

• nonacademic 

Nonpersonel 
Resource Types 



CAMPUS 



VII 



20 
30 

10 

0 
1 



8 
10 



VIM 



350 
100 

25 

4000 

(implicit 
fn activity 
specifica- 
tion) 



10 



150 



125 
110 



120 



RRPM 



1.3 



90 
90 




1.6 



200 
200 



5 
7 
6 
4 



•Source of data: 

A.P. Van Wijk and R.S. Russell, "State ol the Art in Educational Cost Modelling," paper presented at 
the ORSA, TIMS, and All! Joint Meeting in Atlantic City, November 1972, Toronto, Canada: SRC, 
1972, p. 35; K.M. Hussain, op. clt. p. 18, and D.G, Clark, et a I., Int roduction to the Resource 
Require men ts Predic ti on Model 1.6 , Boulder, Colorado, NCHEMS at WICHE, 1972, p. 6. 
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Revenue Module 

RRPM has no revenue module, while both CAMPUS 
VII and CAMPUS VIII do. In CAMPUS, revenue from 
students is estimated as a function of projected enrollment 
and tuition rates. Revenue from public funding agencies 
is calculated by formula which in many cases must be re* 
stated and rep rog rammed in order to meet local needs. The 
revenue components can be projected from year to year 
either by an absolute value or by a given percentage 
change. The model does not include important components 
such as financial aid and portfolio management. 14 What it 
does include is grants, gifts, endowments, and special reve- 
nues which arc treated exogenously instead of making 
them a function of endogenous variables such as student 
enrollment number, type of student programs, etc. 

Capital Budget 

Both RRPM 1.3 and CAMPUS VIII calculate the in- 
cremental cost of capital expenditures resulting from 
projected increase in space requirements. To calculate this, 
however, CAMPUS VIII has a greater facilities-planning 
capability. It ''shuffles'* rooms around according to given 
space substitution and utilization policies: calculates net 
shortages and surpluses of space by type; calculates space 
utilization and maintains inventories of rooms by size and 
types. 

CAMPUS VII calculates the square feel of space and 
number of stations required for its eighteen space types. 
RRPM 1.6 has no space management or capital budgeting 
capability. 

Output Reports 

Alt operational versions have scls of output that vary 
in number and content, but CAMPUS VIII has by far the 
most detailed and comprehensive set. its input data, being 
collected at the lowest activity and organizational level, 
enables it to aggregate its output at all organizational levels. 
The output is particularly good for space management and 
on administrative indices on loading, costing, and 
utilization. 

RRPM 1.3 has a unique report. It identifies on one 
page the results of ten sets of changes made in the "what 
if experimentation mode. 14 The display of results faci- 
litates an analysis of incremental changes and sensitivity 
analysis. For such experimentation the user may make 
blanket changes by percentage or an absolute value in addi- 
tion to replacing one or more values. CAMPUS and RRPM 
1.6 allow only a percentage blanket change and only for a 
select set of variables. 

RRPM 1.3 also has a TRACER - TRAINER routine 
that "traces'* all the intermediate output for any one se- 
lected discipline. 26 This is useful not only in training a user 
on how the model handles his data but also in debugging 
and in validating the model. 

An institutional implementation of RRPM 1.3 has the 



TRACER on a terminal in the programmed instructional 
mode along with routines to help the uninitiated user. 
CAMPUS also has a CA1 package. It has an interactive 
prompter which is especially helpful to the user. 

One final set of comments on comparing differences: 
one must recognize that RRPM has always been con- 
sidered by its designers as one component of an ongoing 
process of developing an inter-related system for planning 
and management in higher education. The NCHEMS 
Student Plow Model, Cost-Finding Principles, Output 
Evaluation, Facilities Analysis and other projects inter- 
relate with RRPM as part of the larger planning and 
management system. 

Perhaps the most important NCHEMS project is that 
on outputs of higher education. This project is concerned 
with identifying the output 27 and developing instruments 
for measuring them. Once this is done, then it will be 
possible to conduct cost-benefit analysis which is so im- 
portant to evaluating performance. This capability will also 
eliminate the current danger and concern that unit costing 
will be misused by funding agencies for allocating re- 
sources among institutions. There is the danger, as Gary 
Andrew points out, that "without definitions and measures 
of outputs* the cost simulators arc likely to lead adminis- 
trators to takd unwarranted actions . . . Cost simulators 
will most likely get blamed for some of the intermediate 
bad decisions and not get credit for speeding up on our 
way to an improved management process by forcing us to 
get off our hands and counter the threat.' ** 28 

Cost of Implementation 

In evaluating models, one should look at their cost- 
effectiveness ratios. The effectiveness of a planning model, 
however cannot all be quantified. Its implicit value could, 
however, be compared to costs, and a judgement could then 
be made as to whether or not the model is worth the cost, 

In calculating the costs, one must differentiate be- 
tween development and operating costs. Development costs 
include the cost of software discussed in Table 3. Other de- 
velopment costs include costs of changing the model to 
meet institutional needs, validating the changes, data 
generation, and training. Typically, the largest component 
is that of data preparation. This, in turn, depends largely 
upon the type and quantity of data required. This could be 
compared for actual implementations of the models, but 
such comparisons invite suspicion since institutions to be 
compared are often different in structure and complexity 
and have different data bases. To overcome this problem, 
one could compare the data generation problem for differ- 
ent types of institutions for each of the models. This is 
done for four types of institutions whose institutional 
characteristics are compared in Table 4. Their data genera- 
tion problems are compared in Table S. 

Data generation is important not only in estimating 
development costs, but also in estimating operational costs. 
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Table 3 

A COMPARISON OF SOME TECHNICAL DATA 




Program Language Used 



Equipment Used 



Minimum Core 
Requirements 
(thousand bytes) 

Cost of Software 

• purchase 

• lease 



Consulting services for 
overall project manage- 
ment, training of senior 
staff and adaption of 
planning manuals. 



CAMPUS 



VII 



FORTRAN 
IV 



Most Com- 
puters 

upward of 
an IBM 
1130 

16 



$12,500 
$ 3,000 
+ 350/m 
for 36m 



VIII 



FORTRAN 
IV 



IBM 

CDC 



256 



$25,000 
$ 6,000 
+ 700/m 
for 36m 



Varies 
$5,000 to $50,000 



RRPM 



1.3 



FORTRAN 
& 

COBOL 

IBM 
CDC 
UNIVAC 



128 



$50.00 



1.6 



COBOL 
(ANSI) 



IBM 

CDC 
UNIVAC 
BORROUGHS 



50 for DOS 
65 for OS 



$50.00 



NCHEMS provides limited 
training at nominal cost. 
Other help in implementation 
is a function of the supply 
and demand of its staff. 



Source of data: 

SRC: "A State of the Art review of Computer - Based Educational Planning Systems," DRAFT 
Unpublished, Aug., 1972, pp. 48, 50, 51, and A.P. Van Wijk and R.S. Russell, op. cit„ pp. 32-35 on 
CAMPUS; K.M. Hussatn, op. cit. on RRPM 1.3, and Clark, et al., op. cit., p. 31, RRPM 1.6 



9 

ERIC 



Hussaln and Mason 



table 4 

CHARACTERISTICS OF INSTITUTIONS COMPARED (FOR 1971-72) 





Multi-Campus University 


Mate 
College 


community 
College 


Main Campus 


Branch Campus 


Student FTE 


18,632 


2,283 


5,284 


2,400 


(Average for Year) 


(Semester) 


(Semester) 


(Quarter) 


(Quarter) 


Highest Degree Offered 


Ph.D. 


Masters 


Masters 


Associate 


Student Programs 


275 


26 


65 


58 


Cost Centers - Academic 


53 


12 


46 


11 


Cost Centers - Non-academic 


47 


9 


20 


21 


Academic Activities 


2,200 


724 


1,200 


244 


Instruction Types 


9 


6 


4 


2 


Student Levels 




D 


6 


1 


Course Levels 


5 


5 


5 


1 


Faculty Rank 


9 


5 


8 


1 


Non-Adacemic Rank 


38 


15 


33 


5 


Space Types 


70 


29 


15 


15 


Other Resource Categories 


19 


10 


10 


3 


Other Resources Subcategories 


56 


31 


4 


7 
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Tabic 5 

COMPARISON OF COST-RELATED ELEMENTS 





Multi-campus UnUersily 




Slale 






Communily 






Main Campus 


Branch Campus 




College 






College 






CAMPUS 


RRPM 


CAMPUS 


RRPM 


CAMPUS 


RRPM 


CAMPUS 


RRPM 




VII 


VIII 


1.3 


lb 


VII 


VJ II 


1.3 


lb 


VII 


VIII 


1.3 


lb 


VII 


VIII 


1.3 


t.b 


Oil* UemtnU 
in ICLM (in 000'*) 


18 


18 IS 


IB 


18 


.3 


19 


.3 


.3 


3 


78 


3 


3 


.6 


14 


.6 


b 


Regression f quilions 
for non-teaching 
salary toils 




2800 


300 






630 








2400 








bOO 






Development Coils * 
in OOO'sof $ 


11 


80 


is 


9 


4 


20 


25 


S 


10 


264 


32 


7 


4 


207 


24 


b 


Run Cost 
for one complete 
set of reports 


3 


500 




J 


2 


200 




2 


2 


300 




3 


2 


200 




2 


Maintenance 
Cost i(\ Anatyst 

m 


1.0 


30 


15 


1.0 


0i5 


0 5 


075 




07 S 




10 


0.5 


0.7 S 


O.S 


0 5 


0.25 



*1h«if to\ts do mjt <fu lude ihr t ost *>\ idm<n.istntofs Morktnft .,n iKr mctJrl. i lkI 
ol vofl*nr. «onsult<nn or use/hrid Sumr itl mit ha sunl i <>sl 



•*Ihr»e i os is nerd nul be out ol po<krl losfs. rspriulft %\ thr mod* J hi'lnml'% 
pjrl of ihr 'nofmil' ootr jtiom of ihr imtiluhun 



Such costs increase greatly when dala elements are updated 
annually. In a cost study done for CSM (the conceptual 
basis for RRPM), Hopkins found (hat annual updating of 
the data base more than doubles the annual operating costs 
of maintaining the model. 23 Maintenance of the data base is 
necessary in order to reflect the changing values of many of 
the parameters in the model. In a study of some depart* 
ments in Berkeley, Brcneman found that the faculty re- 
quirement coefficients vary as much as 200% from one year 
to the next. 10 

Changes to parameters also result during experi- 
mentation when making simulation runs. This increases 
the operational cost (the cost of each simulation run is 
shown in Table 5), which is a necessary cost if one wants 
to investigate the consequences of possible changes. 

Other components of operational costs result from 
the need for continuing analysis of output, and the need for 
training the user. These components arc very important 
aspects of implementation and are not sufficiently recog- 
nized. The estimates for this effort is shown in Table 5.tl 
will vary with institutions and is a function of their 
planning experience; the support lhat they can get from 
other departments such as the Computer Center; the 
number or nature of modifications to the model initiated by 
the user and the Computing Center; the extent of the use of 
the model; and finally the thoroughness with which the 
task is performed. 



In Table 5, the figures for CAMPUS VIII are based 
on emperical data. The figures on RRPM were calculated 
from the manual on that model." The figures on the re- 
maining models were estimated by the writers and their 
colleagues who arc knowledgeable about the institution 
and very knowledgeable about implementation of the 
models concerned. The figures were then checked against 
published data on implementation. Unfortunately there are 
not much data on the implementation of RRPM 1.6 and 
CAMPUS VII since these are relatively new models and 
have few implementations. The number of implementation 
of these and other models are shown in Table 6. 

Summary and Conclusions 

In comparing the class of operational models of 
RRPM and CAMPUS, one can identify the models that 
operate at the discipline or department level as being 
RRPM 1.3, RRPM 1.6 and CAMPUS VII. Among these. 
RRPM 1.6 is conceptually the simplest and least compre- 
hensive. It is also the cheapest in both development and 
operational costs. RRPM 1.3 is slightly less comprehensive 
than CAMPUS VII but is cheaper to develop largely be- 
cause of its negligible costs of software. II does, however, 
require more computer core memory than does CAMPUS 
VII or RRPM 1.6 

CAMPUS VJII is the most comprehensive of all the 
models examined. It is also the most detailed both in the 
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Table 6 

NUMBER OF IMPLEMENTATION* 



CAMPUS VII 3 

CAMPUS V, VI St VII 36 

RRPM 1.3 70° 
RRPM 1.6 

CIM 110° 



* Source of Data: For CAMPUS, the data came from A.P. Van Wijk and R.S. Russell op_. 
cjt-, p. 34, and for RRPM and CIM the data came from NCHIMS at WICHE. 



CIM Is a (raining version of RSPM that after being used for training is also being used 
for planning in the operational mode. It Is conceptually similar to RRPM 1.3, has 
smaller dimensions than either 1.3 or 1.6, and has been implemented only on IBM 
equipment. 



•These figures are hr programs distributed, not necessarily all implemented. 
NCHIMS does not Implement or contrcl the use of its software and hence has no way 
of knowing exactly how many of Ms programs have actually been implemented. 



input required and the output produced. It is, therefore, 
more suitable for decision making at the detailed and de- 
partmental level (for budget or curriculum planning), but 
Ihe price of such capability is larger core requirements and 
higher costs of both development and operations. It also 
has the longest lapse time for implementation (between 9- 
12 months as Compared to 2-8 months for the others). 

Both CAMPUS and RRPM in all their operational 
versions have some common characteristics: they are cost 
and resource models, not cost-benefit models; they are 
simulation models, not optimizing models; 12 they are sub- 
system models, not total system models; they have mostly 
linear equations for calculating their non-salary costs and 
use marginal costs, thereby ignoring economies of scale and 
discontinuities; both are basically student-driven; neither 
model predicls Ihe number of new entrants to Ihe insti- 
tution nor do they relate it to manpower requirements; and 
finally, both are deterministic models (except for the prob- 
ability matrix used in the student flow module). 

From Ihe viewpoint of helping the user implement 
and use the model, neither family of models provides help 
in formulating the support (non-salary) cost equations nor 
in calculating the cost coefficients, Also, no help is 
provided in studying and Improving the stability of para- 



meters, especially the ICLM. Some work has been done 
with CAMPUS and RRPM 1.3 in using terminals but not 
enough work done on the economics and feasibility of 
using the model to respond to "What if" questions in the 
on-line-real-time mode, Also, no help is provided to the 
user in searching through the very large set of permutations 
of possible alternative strategies. Search routines for identi- 
fying "promising" and near optimal strategies will greatly 
help the user. Routines that will "bound" the feasible 
region will help also. The current oulput will help the user 
if it were packaged with graphics that show "trends" and 
"gradients*' rather than masses of numbers. Reports should 
be designed that also help in management by exception by 
identifying infomation and variations that exceed allowable 
levels, Finally, neither model enables the user to calculate 
trade-offs directly. For example, if one wishes to find the 
trade-offs belwcen average section size and faculty load 
which keep the cost constant, one has to guess at pairs of 
values, calculate the costs, and then plot an iso-cost curve. 
This can be both costly in computer time and slow in re- 
sponse time. 

Some of the limitations discussed above will un- 
doubtedly be relaxed in future versions of CAMPUS and 
RRPM (and related models). The RRPM development is 
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related to projects on Identification and Measurement of 
Outcome of Higher Education; Faculty Activity Analysis, 
Program Classification Structure, Data Element Dictionary, 
Co&t Finding Principles, and Information Exchange. For 
implementing these models, NCHEMS is federally funded 
and can call upon Ihe advice and help of personnel from 
any of Its participating institutions. All these resources will 
be required to implement the many ambitious projects that 
NCHEMS has planned. In doing so. it is hoped that it will 
not "drive out" organizations in the private sector that 
develop models such as CAMPUS, HELP/PLANTRAN. and 
SEARCH. These models provide an important choice to 
model users; new users, as well as some that have imple- 
mented RRPM and want more detailed planning informa- 
tion. To the latter group, CAMPUS VIII is a logical choice 
provided they can afford the extra cost. As long as 
CAMPUS continues to remain compatible with basic 
WICHE products on definitions, classifications, and mea- 
sures, it will offer an important upward compatible choice 



for users that have had their planning model experience 
with RRPM. 

Institutions for which neither RRPM nor CAMPUS is 
adequate — such as institutions with heavy noninstruc- 
tlonal emphases — may still find that CAMPUS or RRPM 
provide a basis for building an institutionally unique 
model. 33 These models also provide an important training 
ground for use of planning models. The benefit of these 
large-scale models for structuring and Integrating the insti- 
tution's basic information system will be discussed in 
Madelyn Alexander's paper being given at this Forum on 
implementation of CAMPUS." 

Finally, the implementation of these deterministic 
cost simulation models may be expected to lay the founda- 
tion for development of the next generation of planning- 
budgeting models. Hopefully, this next generation of 
models will provide heuristic and optimizing capabilities 
and will incorporate benefit values as well as costs. 
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u An example is Stanford University, with its major research component, as revealed in its pilot implementation of KRPM 1.2, See K.M. 
Hussain and |. Martin, op. cil.. pp. 75-82, 

»• M. Alexander. The Implementation of CAMPUS/COLORADO at the University of Colorado." Forum of the Association for 
Institutional Research. Vancouver. B.C.. May. 1973. 



WICHE, 1972. 



» Ibid. 
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THE IMPLEMENTATION OF CAMPUS/COLORADO 



Madelyn D. Alexander, University 0/ Colorado 



Implementation of a simulation model means dif- 
ferent things to people at different levels and with dif- 
ferent roles in an institution. To the data analyst, imple- 
emntation is when the model "runs' 1 and is validated. To 
the administrator, it is when the outputs of the model can 
be used in a decision. To a department chairperson, it is 
when he or she can use it to justify additional money in the 
department's budget. 

Churchman and Schainblatt define the "problem of 
implementation" as **tKe problem of determining what acti- 
vities of the scientist and the manager are most appropriate 
to bring about an effective relationship between the two." 1 
If one substitutes the words "analyst or planner" for scien- 
tist and "user" for manager and considers the number of 
users in a university setting, one has an inkling of the enor- 
mous and long term task of trying to make a simulation 
model a useful tool in a university. 

The purpose of this paper is to discuss how the Uni- 



versity of Colorado is implementing the CAMPUS / 
COLORADO model at all levels within the Institution. This 
implementation began as a data problem, and this paper 
will discuss this area in detail; but it soon grew to include 
the projects necessary to carry CAMPUS to all its potential 
users — including the State of Colorado. 

About CAMPUS 

It isn't possible to discuss the implementation as- 
pects of CAMPUS without discussing, a bit, the nalure of 
CAMPUS. 

Figure 1 shows the input to CAMPUS as being of 
four types: 

1. structural definitions 

2. policy/planning factors 

3. student enrollments 

4. inventories 

Slrucfural defini lions are used to "define" the insti- 
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tution to CAMPUS. These enumerate, for example, the cost 
centers (the organizational groupings of the model) and 
their relationships, the types of spaces, types of staff, 
program classification structure, budget functions, and 
other parts of the framework of the data to the model. 

Planning factors are the expressions (variables, co- 
efficients, and relationships) which are used in projecting 
resource requirements. Thsse can be input for each re- 
source type at each cost center. Po//cy factors are coeffi- 
cients which arc input to modify resource requirements ac- 
cording to planned restrictions, expansions, or qualifi- 
cations. 

Student enrollments are the projections which load 
the model. While CAMPUS has a student flow mode! built 



In as an option, these can also be Input for each year of a 
simulation from an externa! analysis. 

Inventories Is a generalized term for "what Is." It In- 
cludes physical space Inventory, staff inventory, other re- 
source inventory (non-personnel operating costs), and the 
inventory of activities offered. (An activity is one com- 
ponent of a course, i p. lecture, lab, recitation.) These 
inventories are used ir the model to show how estimated 
resource requirements relate to existing or base year 
figures. It also allows for the requirements to be "adjusted" 
over compatible types of resources (a small class meeting in 
a larger room). 

Figure 2 shows in more detail how the input relates 
to the various modules (or parts) of CAMPUS. 



Figure 2 
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The magnitude of data elements required in 
CAMPUS is massive. The 1B00 courses In one term on the 
Boulder campus contained 2040 different instructional acti- 
vities in Pall, 1971. Forty-seven types of staff arc defined 
and require identification of inventory, average salary, and 
planning factor information in 100 cost centers. Building 
space is defined by 70 types to be inventoried and planned 
for in 75 space control centers (specially designated cost 
centers). Other nonpersonnel resources are defined into 56 
types in 100 cost centers. There arc 250 student programs (a 
defined student emphasis (major] which leads to a degree, 
certificate, or some other staled objective) at C.U. at 
Boulder, which means that its Induced course matrix is 250 
programs by 2000 activities by six student levels. One can 
quickly conclude that this is a nontrivial amount of in- 
formation. I'd like now to discuss how we approach this 
data collection process, understanding that it has to be done 
every year, without panic. 

About the Data Systems 

Wherever possible, computerized data collection / 
conversion systems have been developed. It is my intent to 
serve four major purposes by this approach: 

1. The amount of hand work necessary to generate the 
input to CAMPUS is reduced. 

2. Intermediate reports arc produced automatically. 

3. All input documents to CAMPUS where manual cod- 
ing is also necessary arc produced automatically with 
existing information pre-coded. 

4. A direct link is provided with operating management 
data systems. 

The reduction of hand work carries significant 
impact in a project the size of CAMPUS at Boulder. The 
time required to code the input would not only be long, it 
would be prohibitive; and even a minor error rate in key- 
punching could carry significant alteration of the results. 

During the conversion of operational data to 
CAMPUS input data, intermediate reports arc produced 
which record this data as it is being converted. This inter- 
mediate reporting is needed for auditing, checking, and 
basic information purposes. Even though CAMPUS is de- 
tailed, there is still substantial aggregation in some areas. 
For example, in the University's personnel system over 200 
actual job class codes arc reduced into 47 types of staff for 
CAMPUS input. Data gathered is also ' massaged'' to pro- 
duce new kinds of data. Thus* CAMPUS forces us to look at 
the data as we had never done in the past, and we needed 
an audit trail to ' find our way." 

When the conversion of data is complete, this data is 
recorded on a report which becomes the input coding docu- 
ment to CAMPUS. Thus this data is pre-coded allowing for 
the insertion manually of planning factor information. 
These reports produced by the computerized data collec- 
tion systems precisely parallel magnetic tape files of the 



actual input to CAMPUS. Planning factors are added many* 
ally to the reports and these reports become the input 
coding sheels to CAMPUS. These manual additions arc 
then keyed on to the tape using a Viatron System 21, 

The direct link with operating systems initially 'pro- 
vides a communications link with people working at the 
operational level in two ways. First, it more clearly Informs 
the data system designers of the analytical needs of the 
planning staff. This serves the long range goal that the 
"institutional analysis files are based on operating data 
systems . , /'* Secondly, this serves as the validation base. 
More will be said about validation later. 

Examination of the operating systems revealed that 
they were supportive of most CAMPUS data requirements 
for the basic inventory systems, as well as the induced 
course load matrix (ICU.'I. 

Figure 3 shows the flow of the data to the CAMPUS 
model. Aside from the policy / planning factors, the other 
manually generated input represents less than 0.5% of the 
input. 

Some details of one of (he automated inventory sys- 
tems is described below as an example. Each of the 
systems is designed to take existing University operating 
files and summarize the pertinent information to produce 
cither direct input to CAMPUS or partially completed 
reports which serve as coding documents with corres- 
ponding magnetic tape files. 

Other Resources System 

Other resources are all non-salary operating ex- 
penditures. 

The Other Resources Inventories are generated di- 
rectly from the year-end Debit and Credit Register main- 
tained by the Finance Office which reflects the actual ex- 
penditures for the fiscal year. 

Two translations are necessary: 

1. the account number translation to the appropri- 
ate cost center; 

2. the object of expenditure code translation to the 
appropriate other resource type. 

The expenditures arc then summaryized for each 
other resource type by cost center. For checking purposes, 
all salary expenditures recorded arc also summarized for 
each cost center and recorded in an intermediate report. 
Pre-coded input records to CAMPUS are generated. 

There were, of course, many problems which beset 
these best laid plans of mice and people. The first was that 
the elements within the data systems were not consistently 
defined. This is a problem which can only be solved by the 
long range approach of common definition development 
and adoption. At the University of Colorado, Administra- 
tive Data Systems is working in this area. It is our hope that 
as these systems arc redefined, the operation of data eollec- f 
lion for CAMPUS will become a normal spin-off from the 
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operating systems and be performed by the data processing 
and operating department staff; thus, totally closing the 
gap* 

Another data problem was finding historical data 
consistently maintained foi one year to provide a" base case 



for validation. Our first selection of 70/71 for a base year 
had to bo changed to 71/72 when It was discovered that In 
70/71 a census student course registration tape had not been 
kept. 
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About Validation 

' Validation holds a special and important role in 
simulation. "3 While it Is easy to believe in the "black box" 
of the model, unless the inputs can be related to familiar 
data, the user cannot and will not use the model because he 
or she will be unable to interpret projection data. Our basic 
choice of working with operating data systems, even though 
many problems were inherent in this approach, was to 
make it possible to clearly define every path of data 
aggregation and/or development. The intermediate reports 
of the data gathering system have proved Invaluable, Un- 
derstanding the data which drives CAMPUS *a 111 lead in 
the long range to an understanding of CAMPUS itself. 

About Documentation 

There is a step which becomes the lifeblood of an 



operation once it has gone beyond the first few months — 
documentation. Dealing with a system as large as 
CAMPUS, it was immediately evident that as much as 
possible should be documented. But how do you work that 
mundane and time-consuming operation into a dynamic 
situation? By doing it along the way. By providing an easy 
mechanism by which any staff member can quickly and 
without much bother record events. The only real problem 
encountered at C.U. v/as reminding steff that documenta- 
tion had to be done! Figure 4 shows a form which was de- 
signed for the purpose of fast documentation — free form 
In the documentation area, but structured so that only a 
checkmark made it "filcablc" and "findablc." This form, 
along with a similar one for recording telephone conversa- 
tions with SRG (Systems Research Group), has successfully 
captured the "history" of the project's decisions and anaiy- 
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sis techniques. 

About Communication 

Tho activities of data cottection and validation are, 
of course, only tho first port of implementing a model, 
Communicating with the users of a model is critical, "In 
mosl complex organizations — including colleges ?nd uni- 
versities — the executive officers, governing boards, operat* 
ing managers, and policy committees are the ultimate users 
ot" analytical models/ 4 Communicating wiih these groups 
has consumed much time and energy particularly since the 
State of Colorado is also involved iu our communication 
program. 

The use of transparencies provides a structured and 
formal format in presentation but allows for great 
flexibility in the development of presentations. Five sets of 
transparencies were developed by Visiting Professor K.M. 
Hussain of the University of New Mexico: 

1. General information on CAMPUS. 

2. Introduction to CAMPUS / COLORADO 

3. How the model works. 

4. Implementation of CAMPUS. 

5. Comparison between CAMPUS and RR M 

A document which explains how CAMPUS works 
was designed by Professor Hussain as a "stand alone" and 
includes problem work sets for greater understanding. In 
addition, video tapes were recorded on the general intro- 
duction to models (in addition to the five presentations 
above) and the comparison between CAMPUS and RRPM. 

These presentations have been used with many audi- 
ences across the University community and the State. 

Currently, however, we are working with four pilot 
departments on the Boulder Campus by extending to them 
detailed, hands-on experience with the model foe them- 
selves. This is being done Jointly with the Committee on 



Academic Planning (of tho Faculty Council) in support of 
an evaluation study of these four departments, By provid- 
ing tho additional data available from CAMPUS to these de- 
partments in the open framework of faculty committee 
project, it is hoped that our communication will bo ampli- 
fied in a natural and positive way, 

Our only concern at this point is that we should have 
communicated sooner with the faculty, "However, wo be- 
lieve that it was necessary to have the computer software 
and the existing data basis in 'fair 1 condition before we 
started discussions with the faculty,' 5 

Some Facts and Figures 

The first year of implementation has included not 
only those items described in this paper, but also system 
development of CAMPUS itself, Wo purchased CAMPUS 
VI with the understanding that it Would be modified to In- 
clude such things as program costing, This was ac- 
complished along with the conversion of tho programs to 
run on the CDC 6400* These development costs are 
included in the Implementation costs presented bclcw. 

Direct Costs from March 1972 to Feb. 1973: $61,000 

Estimated Staff Costs from March 1972 to Feb. 1973: 

$40,000 

In Summation 

Why we chose to go the detailed route of CAMPUS 
is adequately covered elsewhere. We did £o this route and 
believe that the implementation design will permit the 
detail to be handled automatically white allowing for 
greater flexibility in planning down to the department 
level, We also believe this approach to implementation will 
lead to the slow absorption of CAMPUS / COLORADO into 
the operational parts of the University where its impact will 
be most useful 



* Churchman. C.W. and A H, Schainblall, "The Researcher and the Manager; A Dialectic of Implementation," Management Science, 
February 1965. 

4 Chaney, |ohn F., Data Management and /nfcrrcJolcd Data Systems for Higher Education, from the Seminar on the Advanced State- 
of-1hc-ArtfThc Sterling Institute. Washington. D.C.. April 24-20, 19G9, WICHE, Oct. 1969. 

* Van Horn. Richard L., " Validation of Simulation Results." Management Science, |anuary 1971. 

* Mason, Thomas R., The Purpose of Analytical Models: The Perspective of a Model User, University of Colorado, presented al SCUP 
1973 Spring Conference ' Let's End the Confusion about Cost Simulation Models!"* Washington, D.C., to bo published, 

* Andrew, Gary M., CAMPUS al Colorado, University of Colorado, Boulder Colorado, presented at SCUP 1973 Spring Conference "Let's 
End the Confusion about Cost-Simulation Models!' , Washington. D.C to be published, 
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SIMULATING THE UNIVERSITY; 

AN EVALUATION OF EXPERIENCES WITH THE CAMPUS, HELP/PLANTRAN AND SEARCH SYSTEMS 



Jerome P. Wartgow, Governors Stale University 



Recent years have seen much activity in simulation 
modeling for research and planning, and several organi- 
zations have developed simulation models designed es- 
pecially for use by administrators of higher education, 
Although the power and sophistication of this tool have 
been proven in areas of business and government, many 
questions remain to be answered about the effectiveness of 
these models as an aid to adminis.rators of higher 
education. 

The ultimate goal of this application of the xhniquc 
of simulation has been to enable colleges and universities 
to make more rational decisions about the use of their own 
resources and the direction of their development. Rourke 
and Brooks have found that the extent to which this expec- 
tation has been fulfilled in higher education is as yet far 
from clear. While the literature reveals many articles re- 
ferring to the use of simulation as something of u panacea, 
other writers havo expressed doubts concerning the suit- 
ability of its application al a level of complexity com- 
parable to that of administering a university, 

As the flumbcr of colleges and universities using 
simulation models continues to rise, it becomes increas- 
ingly important to examine objectively the reactions to this 
new sconce. This paper provides an assessment of the 
uliliznion of three computer simulation models now being 
applied to administrative problems in selected institutions 
of higher education. 

Method of Procedure 

The problem of evaluating the use of simulation 
systems was approached through an examination of the ex- 
periences reported by colleges and universities that had 
implemented and were utilizing simulation as an adminis- 
trative tool, 

A sampling technique was used to achieve the 
following objectives: (1) the selection of the institutions 
Which represented a variety of organizational structures, 
types of methods of utilizing simulation models, and (2) the 



selection of computer simulation systems that wore repre- 
sentative of Ihose most widely used by institutions of 
higher education. 

The criteria applied were as follows: (t) the institu- 
tion must h-jve had implemented the model at least one 
year prior to the dale of the study, (2) the simulation model 
being used must have been readily available and adaptable 
to utilization in any institution of similar size and organiza- 
tional structure, and (3) the institution must be an insti- 
tution of higher education in the United States. 

When the criteria were applied to tho institutions, it 
was readily determined that onl> three simulation models 
would be involved in the study, These models were identi- 
fied as: (1) CAMPUS, developed and implemented by 
Systems Research Group, Toronto, Canada, (2) HELP / 
PLANTRAN, developed and implemented by Midwest Re- 
seaich Institute, Kansas City, Missouri, and (3) SEARCH, 
devloped and implemented by Peat, Marwick, Mitchell & 
Co., New York, New York, 

The final samplo consisted of (1) a total of eight 
institutions, (2) each of the three simulation systems being 
utilized by at least two institutions, and (3) a variety of 
institutional sizes and types, including two large private 
universities, c two-year college, a private women's college, 
a state university system, and three small private liberal 
arts colleges. The sample is not random, but rather a repre- 
sentation sample of institutional types and the simulation 
models they were utilizing. 

The study incorporated accepted descriptive-survey 
research procedures in the collection and analysis of data. 
Personal semi-structured interviews were conducted at 
each of the participating institutions and experiences with 
the respective simulation models were analyzed under the 
headings of: (a) factors influencing the purchase and imple- 
mentation of the model, (2) experiences during imple- 
mentation, (3) means and methods of utilization, and (4) 
the extent to which the simulation model had achieved its 
objectives. 
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Findings 

Whilo experiences during the Implementation und 
utilization of Computer simulation systems varied front 
college to college* ce tain common factors were identified 
which appeared to contribute to the extent of successful 
utilization. Based on these findings a number of conclu- 
sions and recommendations were drawn, the more signifi- 
cant of which arc summarized below. 

Two primary factors were identified which 
influenced the decision to purchase and Implement a com- 
puter simulation model: (a) the effort of an individual on 
the university staff who had a personal Interest In new 
techniques of management, and (b) a recognized need by 
university personnel for a tool to assist In answering "what 
if" types of questions. 

Two inferences may develop out of these findings. 
First, it might be inferred that the technique of simulation 
is so new that its existence is not common knowledge 
among administrators of higher education, As a result, the 
use of simulation is promoted by that type of individual 
who is aware of and interested in innovative managerial 
techniques generally. 

A second inference might be that the relevance of 
simulation to administering higher education will not be 
generally recognized until the planning process on the 
campus has progressed to a point where administrators are 
forced to decide between alternatives and arc aware of the 
need for information concerning the implications of choos- 
ing one alternative rather than another, At that lime simu- 
lation will be recognized as a useful tool in assisting deci- 
sion-making. 

Once purchased and implemented, simulation 
models were utilized more extensively in those institutions 
which purchased the system to meet a recognized need, 
than in those Institutions which purchased the system 
primarily because of the recommendations of an adminis* 
trative ''innovator." 

No discernible pattern was evident concerning the 
decision to purchase one of the models in preference to an- 
other, although it was clear that much of the discussion 
centered on choosing a model of appropriate complexity. 

The confusion over the desired complexity or simpli- 
city for a given simulation model reinforced a general 
limitation of simulation that can be identified in the litera- 
ture, That is, that in order to represent thr system accurate- 
ly, there is a tendency to develop more complicated models. 
As models become more complicated they become less easy 
to understand and thereby defeat the purpose of construct- 
ing a mcdel (i.e., simplification of the real system to facili- 
tate understanding). 

Experience Reported by Intuitions During Implementa- 
tion of fhe Model* 

The time to make the system operational was signifi- 



cantly underestimated in each implementation. Several 
problems were Identified as contributing to this condition, 
The first and most significant was that considerable modifi- 
cation was required to several of the models prior to utili- 
zation. This factor may have far-reaching implications for 
the use of simulation in higher education, tt might be in- 
ferred that "simulation packages" specifically designed for 
one institution arc not readily adaptable to other insti- 
tutions. This inference would support arguments advanced 
by some administrators concerning the "uniqueness*' of 
higher education and the resultant inapplicability of sci- 
entific management techniques. 

However, when the findings leading to this con- 
clusion arc examined carefully, it appears that another in- 
ference might be more valid, That is, that the immediate 
modification In models arises from the fact that the sophis- 
tication of the user has not developed to a point where ho 
can identify appropriate und Inappropriate users of the 
model. A review of the literature strongly indicated that the 
value of any simulation system is largely dependent upon 
the ability of the user to determine situations in which it is 
appropriate. Extensive modification of the system might 
imply that simulation waa being applied to problem for 
which it was not appropriate. 

A second factor that was identified as contributing to 
the length of time involved in implementation is the in- 
experience of the personnel responsible for using the 
system, The assumption that a person with no prior experi- 
ence with simulation or computers can operate a simulation 
system would appear to be invalid. The findings of the 
study indicate that inexperienced persons may implement 
tho models eventually, but that if simulation is to be con- 
ducted efficiently, tho user must have had some prior ex- 
perience in the use of simulation or computers, or both, 

A misunderstanding of what the term "implementa- 
tion" implies may have been a third factor which contri- 
buted to the discrepancy between actual and estimated im- 
plementation time. Quite possibly, implementation has a 
different meaning for the firms installing the simulation 
model than it does for the institutions that are utilizing 
model, 

Institutions that relied primarily on university per- 
sonnel during implementation experienced more difficulty 
than institutions that utilized the services of the firms that 
developed the models. The least difficulty during the im- 
plementation was reported, by those institutions that con- 
tracted the entire implementation to outside personnel, 
Generally, the problems encountered during implementa- 
tion were in the areas of data collection and computer tech- 
nology. 

A lack of wide and active participation by university 
personnel during initial stages of implementation appeared 
to influence the extent of future utilization of the model. 

From this finding it may be inferred that paitlci- 
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patlon leads to a fuller understanding and eventual accep* 
tance of Iho model This would support tho argument that 
rcslstanco to Iho utilization ol "Scientific Management 
techniques*' stems mostly from men who misunderstand 
the nature of modern administration. Further, in those in- 
stances when participation in the development of tho 
model was limited, and use was also limited, one might 
infer that the model was comparatively unsuccessful as a 
result of misunderstanding on tho part of those who were 
not involved. 

In-service sessions and in-service materials in* 
fluence the extent of utilization of Simulation models. In 
addition to increasing the number of sessions and person- 
nel involved, there was seen to be a greater need for inv 
proving the content of some of the in-service sessions, Con- 
sideration and discussion of the "human element" as it re- 
lated to the use of simulation was seen to be as important to 
successful model utilization as technical considerations. 

Means and Methods oi Utilization 

Simulation was most extensively utilized when a 
formal planning process was in operation at the university 
prior to its implementation, The case reports suggested that 
implementation of a simulation model prior to proper 
preparation tended to complicate rather than clarify its role 
in the overall planning process. In this regcrd, simulation 
was not a substitute for planning but rather a tool to be 
used to supplement the planning process. 

It seems clear that simulation will have relevance 
and applicability to higher education only when a less 
sophisticated system of planning has already been used 
successfully, and when the acknowledged need for further 
and more detailed analysis leads to an understanding of the 
specific circumstances in which this technique is appro- 
priate. 

The amount of confidence placed In the accuracy of 
simulation results (by those persons in a position to make 
decisions based on these results) was found to be a func- 
tion of bre ad participation by the institution's personnel in 
the development of the model and confidence in the indi* 
vidua) conducting the simulation. Greater confidence 
among the users of simulation results was noted when 
there was wide and active participation in the development 
of the assumptions and formulas used in the model. Addi- 
tionally, confidence held by university personnel in the 
ability of the administrator responsible for conducting 
simulation was found to be correlated to confidence in the 
simulation itself. 

The accuracy of the base data in the initial use of the 
model tended to influence the extent of future utilization as 
well as the degree of use confidence in future simulations. 
University personnel often view the initial use of simu- 
lation with cautious skepticism. The careful collection of 
accurate base data will enhance the potential for successful 



utilization and consequently help overcome tho skepticism. 

Based on tho findings of tho study, it was not 
possible to draw any conclusions concerning the most ap* 
propriate institutional office to be responsible for primary 
utilization of the model. 

However, one observation may be relevant. General* 
ly speaking, il appeared that tho personal and political in* 
fluence of tho Indivicual having responsibility for tho !>imu* 
latlon model was a more significant factor in successful 
utilization of the model than the position which he 
occupied. 

Insufficient time tn devote to planning was identi- 
fied as a major impairment to the utilization of simulation 
models. 

Conclusions 

Generally speaking, it is suggested that those persons 
who are roiponsible for development and/or use of uni» 
versily simulation models evaluate the model in terms of 
four basic criteria. 

PERFORMANCE - How effective is the model in 
getting the answers I want? 

UTILITY - How useful is the simulations system? 
How often will it be used? Is it flexible enough to accept 
major changes in organizational structure? How many 
people can make use of it? 

TIME - What is the time required for installation? 
How much lime is required for collecting base data neces* 
sary to operate the system? What is the time required to re* 
trleve information? 

COST - Is the value of the information worth the 
cost of implementation? Will it save money in terms of time 
and personnel? Do we really need one at current costs? 

If the criteria are applied to each of the availablo 
models, much frustration will bo eliminated, Additionally, 
if persons who are responsible for building new models 
utilize these criteria, the potential of simulation for ad- 
ministering higher education will increase significantly. 
Overall, experiences to date have indicated that the time 
and expense involved with simulation models have not 
been justified in terms of the extent of their utilization. 
However, this conclusion must be considered in the 
context of the following qualifications: (1) an important 
benefit of the utilization of these models is that attention of 
focused on long-range planning, (2) the models have the^ 
greatest potential of becoming a valuable and appropriate 
tool in institutions which are in a process of change, and 
(3) the value of computer simulation models in higher 
education is dependent upon the ability of tho user to 
recognize situations in which this tool is needed and appro- 
priate. 

When there was an existing and recognized need for 
a tool to assist in determining the impact of alternative 
courses of action, the model was seen as a relevant and 
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applicable tool. On the other hand, whim models were 
applied to a problem prior lo a need for Iho tool being evi- 
dent, major difficulties were encountered. 

In the opinion of administrators who used simula- 
tion, efficiency of utilization will increase as the user be- 
comes more familiar with the advantages und limitations of 
the system. Additionally, there was an expressed "feeling" 
that just as during implementation of any new adminis- 
trative technique, a certain time factor is necessary to work 
out problems, gain the confidence of the staff, and over- 
come resistance to change. 

As these conditions are met and proper preparations 
made, computer simulation models will have the potential 
of becoming a valuable administrative aid. With the passing 
of time and the satisfaction of certain other stipulations 
which have been identified above, the potential should be 
achieved. At that lime, the use of computer simulation 
models in the administration of higher education will pro- 
vide valuable assistance in the task of mom efficiently allo- 
cating institutional research, 

Recommendations 

In an attempt to capsulate my opinions concerning 

problems and prospects of computer simulation models, I 
have formulated a scries of recommendations. Empirically 
speaking, I would say that consideration of these recom- 
mendations by institutions planning to proceed with 
development and/or implementation of a computer simu- 
lation system will help eliminate some of the problems and 
brighten some of the prospects. 

A specific need and a high level commitment to 
planning should be generally evident in the institution 
prior to implementation of a computer simulation system. 
What happens on campus prior to implementation ;s just as 
important in terms of successful utilization as what 
hapoens following implementation. 

An institution should carefully select a model or 
systen, that is best suited to the unique needs of the indi- 
vidual ollege or university. Care must be taken to insure 
that the n.odel is not too simple to represent the institution 
adequately or too complicated to be easily understood. 

An institution should take care lest it underestimate 
the time necessary to make the system operational follow- 
ing the decision to purchase. Experiences reported indicate 
that the time necessary to opcrationalizc the system is 
generally significantly longer than the initial estimate. 

An institution or installing agent should define and 
clarify what is meant by the terms "installing/ 1 "imple- 
menting." and "operationalizing" the model, Experience 
has shown that these terms often have a different meaning 
for the firms installing the model than for the institution 
that is using the model. 

An institution should encourage wise and active 
participation and involvement with the model from the 



outset. Lack of participation by the institution's personnel 
in the development of assumptions und formulas to bo used 
In the model is a strong predictor of unsuccessful utili- 
zation. 

An institution should employ a person to physically 
operate the system who has prior experience with models, 
computers, or both. The findings of the study indicate that, 
contrary to prevalent assumptions, a person with no prior 
experience in these areas cannot efficiently operate the 
system. 

An institution should employ the services of one of 
the professional firms to implement the fcystem. Experience 
has shown that this may be less costly than attempting the 
task solely with college or university personnel. 

An institution or installing agent should thoroughly 
discuss the rationale for any initial major technical or con- 
ceptual modifications In the models. It may be possible that 
the model is not appropriate for the institution, or more 
likely, that the problem being approached is not appro- 
priate for the model. 

An institution should be prepared to evaluate in- 
service sessions and in-service materials lo be sure that the 
content as well as the number of sessions is adequate to 
meet the needs of the institution. In-service sessions should 
deal with "human elements" which may cause problems 
during utilization, as well as technical details necessary to 
operate the system. 

An institution should provide adequate time for the 
administrator who is responsible for utilizing the model to 
perform this function. Experience indicates that purchasing 
a system and giving it to an administrator as a "spare-time" 
activity is a poor investment. 

An institution may establish confidence in the re- 
sults of the system by placing the model in the office of an 
administrator whose judgment is respected and who has an 
appropriate level of personal and political influence and 
prestige within the institution. Although this may cause 
problems if the individual leaves the institution, ex- 
periences indicate that the confidence that university per- 
sonnel have in future simulations is positively correlated to 
the confidence obtained as a result of the initial utilization. 

An institution should take extreme c ire in the collec- 
tion of base data to be used in the model. Do net attempt to 
conduct any studies with the system until the staff has 
complete confidence in the validity and accuracy of the 
base data. If the institution is not experiencing major 
change of one form' or another, it should carefully weigh 
the value of a computer simulation model against the time 
and expense involved in its purchase and implementation. 

An institution should only use the system In areas 
for which it is more appropriate than other techniques. The 
ability to determine when simulation is, and is not appro- 
priate, is the primary determinant of its value to the 
institution. 
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RESOURCE PREDICTION MODELS: 

A DO-IT-YOURSELF APPROACH FOR INSTITUTIONAL RESEARCHERS 
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No well-informed administrator questions the 
virtuoso attributes of the well-known simulation models. 
Yet their potential utility is questionable in many in- 
stitutions. The anamoly is easily explained. The models 
tend to be internally driven — especially by enrollment, 
Hut the crucial issues for today's colleges and universities 
lend to be external: attitudes toward higher education, 
national economic fluctuations, demographic trends, the 
vaguerics of politics. These arc issues which require solid 
research and continuous monitoring if their influence upon 
a particular institution Is to be understood, Such research 
and monitoring often are inadequate or wholly tacking, 
One is surprised to find in the modern world college 
officers and governing boards who pcrfcr envelope backs to 
research studies, but they are plentiful in smaller institu- 
tions and not unheard of in major universities, However 
reluctant top management may be. colleges and universities 
are now being forced by circumstance to pursue will-o'-the- 
wisp, modern management techniques. Their initial forays 
sometimes are into simulation models, At times, ond 
perhaps frequently, the results must reaffirm our favorite 
aphorism, "garbage in, garbage out," 

The developers of elaborate simulation models stress 
thai the utility of the models is constrained by the data fed 
into thorn, and that data on the future arc especially elusive. 
NCHEMS, for example, in its "A blueprint for RRPM 1.6 
Application" (WICHE. February 1973). warns: 

The fifth step of the implementation process in- 
volves the difficult task of developing alternative 
sets of specific planning decisions that use the 
status quo reports as a point of departure. Many 
individuals including faculty, students, lay boards, 
and administrators will probably play a part in 
this process of developing alternative plans. The 
technician musl be available to the decision 
makers to translate their decisions into the 
required RRPM input data formats and to carry out 
the sixth step, which is making the RRPM projec- 



tion runs for each alternative set of planning 
decisions. 

Others besides NCHEMS have already pointed effectively 
to the need for good historical data and soundly conceived 
future data if simulation models arc not to be misleading, 
even dangerous, as decision-making tools, 

How are the dangers reduced or avoided? One way 
is for the institutional researcher to take the lead in 
developing simulation models which arc easily understood 
by officers and governing boards, and which arc tailored to 
a particular institution's circumstances and policy issues — 
a do-it-yourself approach. 

In 1972 we developed at Fisk a do-it-yourself model 
for Fisk's financial projections even though we knew that 
in 1973 we would begin operating the >'CHEMS Induced 
Course Load Matrix, the RRPM 1.6, and the Cost-Finding 
Principles. The model immediately proved valuable in 
tesolving policy issues, It is still valuable as a complement 
to the three N'CHEMS systems, which arc now operating. 

The need for projecting the operating budget into the 
future was perceived toward the end of the innumerable 
long, dreary, depressing meetings of administrators and 
senior faculty in which vvc refined our knowledge of the 
University's academic and fiscal problems. We were 
concerned that a trend of financial deterioration beginning 
in the latter ^(iO's might not be reversed quickly enough, 
and we were dissatisfied with our lone five-year financial 
projection, We needed to explore alternative fiscal paths 
and we chose to do so by developing a model which would 
simulate Fisk's operating budget five years into the future. 

The Model and the Computer Program 

Examine Exhibit One, The items on the left arc the 
major parameters which concerned us as we discussed the 
University's finances. They are, I believe, typical of the 
majoi fiscal concerns in most small institutions. Each item 
in Exhibit One is subject to change cither by policy 
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revision or by the Influence of national conditions, Hence 
these items became variables in the model, They ure 
independent variables — thai is, each can vary in- 
dependently or other variables, and none of them are 
determined by the others. A change in any independent 
variable affects one or more items in the operating budget 
as well as the budget totals, The dependent variables are 
the line items of the budget. 

Fisk's budget officer then sketched the model, Its 
essence is to specify precisely what dollar changes will 
occur in the operating budget as a result of a change in any 
independent variable. Drawing from his knowledge of our 
recent financial experience, h'j completed that task in a few 
hours. The following weekend he transformed the model 
into a computer program. 

The elements of the model are: 
(t) The Fisk budget for 1972-73 (major categories only) 

supplies the base amounts from which the amounts for 

future years are calculated, 

(2) Each major category in the operating budget is pro- 
jected through the five-year period ending with 1977- 
78. 

(3) In each trial projection, quantities are set for each of 
the following 20 independent variables — whatever 
quantities the user of the computer program chooses — 
which become inputs into the computer program. Sec 
Exhibit One for an example. 

ci. Enrollment. 

b. Student- faculty ratio. 

c. Net square feel used in activities budgeted against 
educational and general items. 

d. The minimum number of square feet of education 
unci general sp«cc permited for each student; this 
permits a calculation of enrollment capacity. 

e. Tuition and fees per student. 

f. Room and board charges per student. 

g. The dollar income from federal programs each 
year, distributed between: 

(1) Ninety percent to the revenue item ''spon- 
sored research ami programs," 

(2) Ten percent to the revenue item "in- 
direct costs." 

h. Expenditures of federal program funds, divided 
between: 

(1) Percent supporting Fisk's regular, on- 
going programs of inst ruction and ad- 
ministration (all of which are E&G items). 

(2) Percent supporting institutes, research, 
and other activities which are not funda- 
mental to Fisk's regular, on-going academic 
and administrative programs, 

i. Endowment value. ■ 

j. Percent of endowment value used as endowment 
support. 



k. Privates gifts and grants allocated to the operating 
budget — excluding amounts budgeted under the 
new Ford Development Program, and gifts and 
grants for capital programs. 

1. Income from the Ford Foundation's Development 
Program allocation to the operating budget. 

m, Federal subsidies to higher education institutions, 
as estimated on the basis of Higher Education Act 
of 1972. 

n, An inflation factor affecting all expenditure items. 

o. Percent increase per student for instructional im- 
provement over and above increased costs result- 
ing from inflation. 

p. Average faculty salaries. 

q. Library expenditures calculated as a percent of 
total E#G expenditures. 

r. Expenditures on financial aid to students, ex- 
pressed as a percent of income from tuition and 
fees (this is called "full-aid equivalent" because it 
is equivalent to the percent of students on 
financial aid if every financial aid package con- 
sists of the full cost of tuition, fees, room and 
board, and if no smaller packages were awarded). 

s. An efficiency factor for administrative expendi- 
tures — allowing real costs (that is. dollar expen- 
ditures measured in constant dollars) to be 
adjusted downward as administrative resources 
are used more efficiently. 

t. Number of students residing in dormitories. 

(4) A set of simple equations instructing the computer how 
to use these inputs to calculate the "correct'' amount 
for each major item of the operating budget in each 
year through 19/7-78, 

(5) The resulting calculations for each trial projection, 
shown on a computer printout as Fisk's operating 
budget (major categories only) each year from 1972-73 
through 1977-78. 

Si me 40 different projections — each with a dif- 
ferent set of input data — were run on the computer. Only 
one of \Ycsc projections is reproduced here in the three 
exhibits, 

The Base Projection: Current Policies 

To understand *he starting point for the projections, 
the reader should examine the exhibits. This "base projec- 
tion" is a test of the feasibility of risk's present policies if 
they were r o remain unchanged over a five-year period. The 
data and assumptions for the base projection were selected 
according (o three criteria: 

First, that all decision-making until 1978 will be In 
accordance with Fisk policy as established in the summer 
of 1972: 

Second, that in matters not governed by policy, the 
assumptions used as inputs in the computer program 
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txhiblt 1 

TRIAL PROJECTIONS OF OPERATION BUDGET 
PROJECTION NO. 1 

PURPOSE: T« test the feasibility of eiltting policies combined with conlervetlve estimates of fulure trends. 



Input of variable data 



Nonmonetary. 

I. Average enrollment 
2 No. of f.T.I. faculty 
i. Ratio of students 1o faculty 
4. Net squire feel to TAG uiei 

Revenue!: 

5 Tuition A feei per student 

6 Room A board fees per student 

7. federal ipon tor ed program i 
4. \ to Indirect costs 
b. \ 1o Institutional support 

8. Endowment n'ue 

9. Ford Development P.ogram 

10. total private ejfls A giants excluding 

lord Development Program 

11. Federal uOildiet to private colleges 

Expenditures: 

II. Inflation (actor tor all expenditure 

Itemi 

IJ. % Increaie per ttudenl for Instructional 
Improvement 

14. Average faculty talarlei 

15. TotaMacufty taUrlei 

16. % of itudent body awarded financial aid 

(full-aid equivalent) 

•The budgeted amounti for 1972-71 were preliminary; they later were revised substantially. 



Exhibit 2 
FISK UNIVERSITY 
TRIAL PROJECTIONS OF OPERATING BUDGET 
PROJECTION NO. 1 















ftve-Vea? 


ludg*' • 












Increase 


I972-7J 


I97J-74 


1974-75 


1975-76 


I9/&-77 


1977-76 


or Decrease 




1 if 3 


1o)U 


i /*> 




1 7 i> 


4 15% 


no 


1C8 


106 


106 


108 


108 


♦3% 


H6.1 


14.6:1 


15.3:1 


16:1 


16:1 


16:1 


4 18% 


198 000 


200,000 


200.000 


2)0,000 


240,000 


250,000 


+ 26% 


$v7S0 


St85S 


$1965 


$2065 


$2210 


$2)40 


+ 34% 


$im 


$1285 


$135J 


$1420 


$1490 


$15bS 


4 28% 


$2 0 ft.i. 


$2.2 ml. 


$2.1 ml. 


$2.4 ml. 


$2.5 ml. 


$2.6 mi. 


4 30% 


1(K 


10% 


10\ 


10% 


10% 


10% 


Constant 


3S\ 


3S\ 


35\ 


3S% 


3S% 


35% 


constant 


$7.4 ml. 


$7.4 ml. 


$7.4 ml. 


$7.4 ml. 


$7.4 mi. 


$7.4 ml. 


0% 


$700,000 


15)0,000 


$401000 


$305,000 


$151000 


$155,000 


76% 


$1,2910% 


$1,419,000 


$1,180,000 


$1,162,000 


$1,139,000 


Si )5?,000 


4 5% 


0 


0 


0 


0 


0 


0 


0% 


5% 


5% 


5% 


5% 


5% 


5% 


4 28% 


2% 


2% 


2% 


2% 


2% 


2% 


4 10% 


$14,150 


$15,140 


$16,200 


$17,334 


$18,548 


$19,846 


4 40% 


S1.5S6.S0O 


$1,611,120 


$1,749,600 


$1,672,072 


$2,003,184 


$2,143,368 


4)8% 


10% 


10% 


30% 


30% 


30% 


30% 


0% 



PURPOSE: To lest the feasibility of emitting policies combined with ton%tr**tht estimates of Mure trend*. 



Five -Year 





ludget* 












Increase 


REVENUE 


1972-73 


1973-74 


1974-75 


197S-76 


1976-77 


1977-78 


or Oetrease 


Iducation and General: 
















Tuition & fees 


$3,593,775 


$2.77S.S41 


$3,080,1)7 


$3,416,793 


$3,621,637 


W« 14,67 4 


4 46% 


Sponsored Research A Programs 


1,803,530 


1,980,000 


2.070,000 


2,160,000 


2,250,000 


2,340,000 


4 30% 


Endowment Support 


445,200 


472,340 


472,340 


472,340 


472,540 


472.140 


4 6% 


Gifts A Grants (excluding ford Dev. Pro.} 


1,295,096 


1,419.000 


1,180,000 


1,162,000 


1,139,000 


t, 357,000 


4 5% 


Ford foundation Development Program 


700,000 


S 30,000 


405,000 


305,000 


155,000 


155,000 


-78% 


federal A Tenn. Institutional Subsidies 


0 


0 


0 


0 


0 


0 


0% 


Indirect federal Support 


187,612 - 


220,000 


230,000 


240,000 


250.000 


260,000 


4 39% 


Other 


334,746 


3S1.463 


369.057 


387,510 


406.885 


427.230 


4 26% 


Subtotal Education A General 


$7,359*959 


$7,746,)67 


$7,606,535 


$8,143,644 


$8,294,864 


$8,646,246 


4 20.2% 


Auiltii'y Enterprises: 
















Oining A Oormitoriet 


$1,492,637 


$1, 586,974 


$1,667,249 


$1, 75 3,699 


$1,840,149 


$1,932,774 


4 25% 


800 V store, Real Estate, Miscellaneous 


268,420 


287,918 


316.710 


347,662 


355,045 


383.297 


443% 


Athletics A Radio 


41,950 


29,467 


32,436 


31606 


37,386 


39,256 


•6% 


Subtotal Auxiliary Enterprises 


$1,803,00? 


$1,9t4,\81 


$2,016,397 


$2,1)6,968 


$2,242,582 


$2,155,128 


4 10.6% 


financial Aid: 
















Subtotal federal Grants (EOG, Work 
















Study, Miscellaneous) 


$ 852,230 


$ 'US. 5 8' 


$1,033,541 


$1,134,347 


f 1.191,2/4 


$1,250,036 


4 46.6% 


TOTAL AtVfNUt 


$10,015,196 


$10,592,3)1 


$10,856,473 


$11,415,159 


$1 1,728,720 


$12,452,412 


4 24.1% 



NOTl: SuMotats and totals may vary slightly Irom the apparently correct amounts became ol rounding. 
'The K> dueled amounts for 1972-71 vere preliminary; they later were revised substantially. 
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Exhibit 3 
FISK UNIVERSITY 
TRIAL PROJECTIONS OF OPERATING BUDGET 
PROJECTION NO. 1 



POMOSfc To (til the legibility of editing pollcle* combined with <on*emttve eitlmaiei of Mure irendt. 



IMCNDtTURf^ 




197174 


1974 75 


1975-76 


1976-77 


197776 


Five-Veir 
Inoeaie 
or Oecreaie 


tduotlon and General: 
InttriKt'on 4 Or|»nlied Aclivitlci 
SpofMvf t d Rf tf irch !■ Proirimi 
Wbfary 

Student Service* 
Central Admlnltlrallon 
weveloomenf-AlumnlUnlvtriily fteMlom 
General Institution 4 Staff lenenti 
Phviical facilitle* 


$ 2,1 15,050 
1 ,57 2,9t» 1 
37L69I 
616.081 
471,450 
1*9.380 
MM 11 
624,8*0 


$ 2,203,591 
1.287.000 
323.01J 
646.886 
495.022 
198,848 
642.087 
663,618 


$ 2,353,868 

1 111 t/W*l 

340*967 
679,230 
519,773 
206.791 
674.191 
697.009 


$ 2,515,022 
1,404,000 
365,618 
713,192 
545,762 
219,231 
707,901 
841,639 


$ 2,693,589 
1,402,500 
39J.26I 
784,511 
600,338 
230,192 
778.691 
922,143 


$ 2,864.634 
1,521,000 
417.255 
623.737 
630.355 
241.702 
817.626 
1.008.594 


+ 36\ 
+ 11\ 

♦ 12% 
+ 34\ 
4 34% 

♦ 26% 

♦ 34% 

♦ 61% 


Sublotal tducallon i> General 


S 6,372,9*6 


$ 6,460,2*8 


$ 6,819,353 


$ 7,312,367 


$ 7,865,228 


$6,145,104 


♦ 30.6% 


Auxiliary Intf rprlstf: 
Olnln| $t OofmllOfle* 
loofcltOf *, It J' fttate, MiiceiUneom 
AtNletlci, Radio 


$1,467,176 
261,151 
106,985 


$ 1.586,974 
287.918 
117.950 


$ 1,667,249 
316,710 
129.74C 


$ 1,753,699 
347.662 
142.425 


$ 1,840,149 
365.045 
149,457 


$1,932,774 
363.297 
1 57,024 


♦ m 

+ 47% 

♦ 47% 


Sublotal Au*l)Ury Interpret 


$ U1I.II2 


$ 1,992,844 


$ 2,113,706 


$ 1,243.78? 


$ 2,354,742 


$ 2.47J.096 


♦ 34.8% 


financial Aid: 
















Subtotal S<holar»hlps A Othei Grant* 


$1,706.87.1 


$ 1,483.650 


$ 1,640,925 


$ 1,613,837 


$ 1.914,750 


$ 2,020.837 


♦ 16% 


Contingency 




$ 250,000 


$ 250,000 


$ 250,000 


$ 250,000 


$ 253.000 




TOTAL EKFCNOItURCS 


$ 9.9l$,t$1 


$IO,t86,762 


$t 0,82 3,984 


$11.6)9,991 


$12,364,720 


$13,069,067 


♦ 32.0% 


Sufplui of revenue* over etpendtturet 


$ 100.045 


$ 405,568 


$ 32.488 










Additional revenue* required 








$ 204,832 


$ 656,000 


$ 636.625 





NOTEt Subtotal* and totals may vary ilighlly from the apparently correct amount* became of rounding. 
*The budgeted amount* tot 1972 7) vvere preliminary: they later were reviled lubttantlally. 



should reflect our estimate of the conditions and trends 
which will prevail during the projection period; and 

Third, that where "the most probable conditions or 
trends" are seen as a range of data in every year rather than 
as a single series of data, the assumptions should reflect 
conservative estimates — usually interpreted as changes 
causing income estimates to be near the lower side of the 
probable range, and expenditure estimates to be near the 
upper side of the probable range. 

The resulting total revenue (Exhibit Two, last row) 
rose very modestly indeed — only by 28.1 percent in five 
years. This result deviated abruptly from the experience of 
the recent golden years. We looked for errors. None were 
found. There could be only one interpretation: that if Fisk 
policies should persist unchanged through 1977-78, and if 
cur estimates of non-policy trends were not unnecessarily 
conservative, then \hc trend of large increases in revenue 
from all sources, seen continuously over more than a 
decade, had ended in 1972-73. 

The increase in total expenditures ( Exhibit Three, 
third from last row) was accounted for largely by the in- 
flation factor. A five percent increase when compounded 
five years beromes 28 percent, and total expenditures rose 
only 38.2 percent. 



The last two rows of Exhibit Three gave us the 
answers which we were seeking. The surplus of revenues 
over expenditures would have a short life, if any. The ad- 
ditional revenues required — a euphemism for the word 
"deficit' 1 — would mount rapidly. The rise in the deficit was 
more dramatic than we had expected, 

Fisk's position here differs little from that ot most 
leading private colleges and universities which have 
analyzed thoroughly their financial positions. They arc 
currently operating approximately in balance and thny can 
even predict - u occasional surplus. Hut their fiscal stability 
is in the words of Mr. Cheit, fragile. 

Our model had given us quantitative insights into 
the trends. Because of the considerable resca f ch that under- 
girded the projections, we felt that they were about as 
accurate as any projections can be, Something had to 
change — and quickly. The question was: What? And so 
we continuod to run the program, altering the 20 variables. 

Uses of the Do-It*Yourself Model 

Our goal then became to discover a combination of 
policies which would keep the budget balanced without 
educational retrenchment. The model allowed us to seek a 
solution through an iterative process, After innumerable 
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computer runs, each of ten minutes duration, we chose; a 
combination of policy variables, which we believed was an 
oplimum combination. We did so in the ligh! of several 
Institutional studies concerned with major variables in the 
model, The variables so chosen became our recommen* 
dations on fees, enrollment, faculty, size, space, gifts and 
grants, and allocations to major expenditure categories, 
Many of the recommendations were incorporated in the 
budge* for 1973-74, anil some became University policy to 
1978. 

Comparison with NCHEMS Systems 

The NCHEMS ICLM. the RRPM 1.6 and the Cost- 
Finding Principles arc evon newer to us at Fisk than is the 
do-it-yourself model, Our initial reaction to them is that the 
several models arc fine complements to one another. 
Together they appear to give beautiful results for decision- 
making. 

The RRPM 1.0 supplies cost detail in abundance 
such as the direct costs of programs, measures of faculty 
productivity, and requirements for non-faculty personnel. It 
lacks the indirect costs of educational programs and the 
costs of their research components. From our point of view, 
however, it has only ire major deficiency: it is not 
concerned with income. 

The NCHEMS Cost-Finding Principles, which 
converts expenditure data into program costs, yields results 
which arc especially well suited to decision-making in 
years of fiscal stringency. Because of the considerable 
detail yielded by this program and by the RRPM t.6, we 
view both of them as models or systems for the micro 
analysis of costs. 

By contrast, the do-it-yourself model involves only 
macroanalysis — a broad-brush treatment of budget projec- 
tions — but it analyzes income as welt as costs. Its advant- 
ages, we have found, are: 

(1) That it was written to give specific answers to specific 
issues of a specific university; 

(2) That it forces faculty, administrators, and trustees to 
face major issues of policy and to revise major assump- 
tions while not bothering them with details which they 
might refuse to study; 

(3) That its results are readily perceived and understood 
by officers and trustees — who are used to thinking in 
terms of major budget categories; 

(4) That it supplies an analyais of income; 

(5) That it has a quick turn-around time and is convenient 



to operate; 

(6) That projections are not from unit costs they are 
non-linear; allowing economies of scale and other 
fluctuations; and 

(7) That it was inexpensive to develop and it operates at 
virtually no cost. (It was developed at a cost of less 
than $1,000 in the time of staff and about $50 for the 
cost of operating the computer.) 

The do-it-yourself model's disadvantages appear to be; 

(tj That it lacks the detail required to resolve numerous 
issues and policy matters (the NCHEMS systems 
supply much of this needed detail on the expenditure 
side): 

(2) That when its results are misleading, this may not be 
ii \>arcnt immediately; and 

(3) That when its results aro prima facie erroneous, it 
tends to conceal the sourci * of error9. 

The Role of Institutional Research 

The role of institutional research in planning at Fisk 
is to pursue studies which supply information and 
estimates about the critical planning parameters, to assist 
colleagues in focusing squarely upon the main issues of the 
day and of the future, and to intcrwinc institutional studies 
and planning documents so that the two functions of insti- 
tutional research and planning often arc indistinguishable. 
We believe that the University benefits from this in- 
tertwining of functions, and we arc beginning to amass evi- 
dence which will demonstrate these benefits conclusively. 
If the do-it-yourself model does indeed have the utility 
which we believe it has, and if the NCHEMS systems prove 
as useful in planning as we expect them to. these advant- 
ages should be attributed in some measure to the 
undergirding supplied by institutional research to the plan- 
ning processes and to the intertwining of the two functions. 
Time will tell. 

We have no major concerns about the NCHEMS 
systems, which are well-received on campus. We are 
pleased with them and with the do-it-yourself model. We 
know of course that such systems and models can be 
developed and operated with input data from envelope 
backs. But they deserve better treatment. As decision- 
making tools, they aro not sufficient unto themselves. 
Healthy doses of institutional research are the missing 
ingredientSv and they can best be supplied if planning and 
institutional research are intertwined or, better yet t if they 
ere merged. 
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PLANNINO-MANAGEMENT SYSTEMS IN HIGHER EDUCATION! 
WILL THEV REALLY MAKE A SIGNIFICANT CONTRIBUTION TO 
IMPROVING INTERNAL DECISIONS? 



Peggy Helm, Bucwnoll University 



Much attention has been given to the development of 
Management Information Systems and budgeting 
methodologies, Including Programming. Planning, and 
Budgeting (PPU) and cost*finding principles. Much money 
ha9 been spent on developmental programs, Even more 
may bo spent on Implementation. 

It has been said that within a few years institutions 
will bo required to submit data in NCHEMS form to qualify 
for any governmental funding, There is real question 
whether data of tho NCHEMS magnitude and complexity 
are really needed by the government and whether their 
broad category statistical compilations that come out late 
are worth the total cost of data collection and preparation. 
Even more important is the quostion, Will the underlying 
Management Information System provldo much useful 
assistance in internal decision-making? Please note that I 
distinguish between reality and theoretical possibility. 

Those of us who have been Involved, either directly 
or indirectly, in the development of large Management 
Information Systems may have become overly enthusiastic. 
Wc aro like some corporato product-managers. Wo have 
dono some market research in needs and wants, but wc 
have given insufficient attention to ways in which the 
college may want to apply tho product and to organizational 
environments in which the product a must be used. Wc 
have brought forth a tool designed for a flexible hand with 
an opposable thumb. But the organisations for which it is 
intended havo only a paw. 

There arc various reasons Planning»Mancgcmcnt 
Syitcms may have more benefits claimed for them than 
they can deliver. These reasons might be classified roughly 
as first, technical, and second, organizational, sociological, 
and psychological. 

Consider the technical reasons from the standpoint 
of the three main parts of a Planning-Management System 
— the data file, a package of standard reports generated 
from lime to time, and a set of models and analytical 
packages, such as a resource prediction model and cost- 
finding programs. 

The data file: For economic reasons the data file will 
not be, and should not be, complete. Completeness means 
that one has everything one could conceivably need. This 



often means coding things different ways — indeed, tens of 
different ways. They may also havo to bo broken down Into 
component parts — not just one set of component parts, but 
many different sets, for even tho same user may want tho 
analysis prepared different ways. And each part wilt 
probably require several pieces of supplementary Informa- 
tion for analytical purposes. Updating so largo a data baso 
becomes cumbersome and costly, Tho data user will there- 
fore have to accept something loss than what ho wants or 
the additional costs of custom*tailortng analyses and 
reports, Either situation will reduce the usefulness of 
Planning-Managcmcnt Systems. 

Standard reports: We will discover that regardless of 
how many ways wo count things, data users will claim they 
aro not meaningful because something should havo been 
excluded or something clso Included. On the other hand, If 
we produce all tho variations that might conceivably be 
needed, users will be awash with reports. If overwhelmed, 
potential users will not refer to our products cither. 

Models and analytical programs: There are obviously 
questions on the usefulness of models: 

First, modeling technology is best adapted to rcla* 
lively static conditions, but wc actually face a period of 
significant economic and social change. Major variables arc 
changing rapidly — prices, wages and salaries, working 
conditions, modes of instruction, course patterns, and off* 
campus study to name a few. Results will be no better than 
the model itself. Even the more complex models and 
systems may yield disappointing results, This occurs 
because formalized models lack flexibility and versatility. 
Simulation models or cosl*finding models arc acceptable 
only if the players accept the rules of the game. There is 
considerable question whether the potential data users — 
the various administrators, department chairmen, and 
faculty members — want to accept the same rules. There is 
also doubt whether they even want to play the same game. 

A second reason to question the usefulness of Plan- 
ning-management Systems is that they understandably give 
considerable emphasis to cost-finding programs. These are 
average costs and average inputs. But the significant factors 
from the standpoint of internal decisionmaking arc the 
incremental inputs, costs, and outputs. They may bear little 
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relationship to avoruge costs or outputs. Morcovor, tho best 
wo seem to do with measuring outputs is to count some* 
thing, such OS tho degrees conferred by major, scores on 
graduate record oxoms, percentogo entering graduato or 
professional school, and So on — crude dovices for 
measuring quality. 

A third criticism of simulation model* and cost* 
finding programs is that thoy arc too mechanistic. Wc focus 
our attention on tho wrong factors and tho wrong objec- 
tives. This occurs because wc fail to define the problem 
properly. Wo are more likely to isolate a factor and then 
defino that factor as a problem. Tako faculty tenure as an 
example Tho basic problem is not really one of tho propor- 
tion tenured but of providing flexibility, vitality, and appro- 
priateness of program, Tenure Is only ono part of a much 
broader problem, Its control therefore provides only one 
facet of a solution. 31nco individuals focus more easily on 
simple mechanistic factors than on complox problems, any 
system which facilitates a simplistic approach may 
inadvertently lead us down the primroso path. In over- 
looking the basic problem, wo miss more effective 
solutions. 

Even If we did not encountor these technical 
porbtcms, there is another problem, namely the application 
of (Manning-Management Systems in a complex social 
organization. Since you aro familiar with tho various 
requisites for the successful use of Planning-Management 
Systems, thero aro only two points I shall make. 

First, the appropriate college administrators must be 
willing to come to grips with painful decisions, particularly 
the President. These decisions usually involve people. But 
too often decisions aro not made. The institution drifts. Or 
becauso they involve people, the decisions are made tho 
wrong way. 

The second requisite is tho distribution of respon- 
sibility, theoretical authority, and practical power. The 
introduction of Planning-Management Systems would be 
one thing in the classical organizational pattern (the 
pyr?~nid) where authority is concentrated at the top, and 
delegated, along with responsibilities, to lower levels of ad* 
ministration and where job retention and salaries depend 
upon job performance. But our institutions of higher educa- 
tion are organized on a collegial principle carried to the 
point whore many, If not most, institutions have 
administration by committee. The committees have mixed 
constituencies, depending upon the institution and the 
particular committee. In most institutions faculty continue 
to exercise Strong, if not dominant, influence within the 
committee, and thus within the institution. It is important 
to note that most of the Committee members — the faculty 
— are employed to perform other functions, like teaching 
and research — not to manage the institution. Their jobs do 



not dopond on how well thoy mako administrative 
dr t ^ions. Thero aro also many sociological reasons Why 
thoy might not bo oxpected to make hard decisions and to 
use management data In making them. But evon if wo ara 
able to educato them, tho committco mombcrshlp changes, 
Each year wo start tho educational procoss all over again, tn 
viow of theso problems I suspect it will take considerable 
timo before educational institutions bogln to derive great 
benefit from Planning-Management Systems 

Wo now come to tho hard question: What can tho In- 
stitutional planner do? What should ho do? 

(1) Do not oversell Planning-Management Systems, 
Tell them how it might help them; but tell them how It 
might not. 

(2) Do your own markot research with key ad* 
mlnistrators, Attempt to identify probloms which disturb 
them — probloms which soem important to Iho 
administrator and which they bclievo should bo tackled, 
Then try to assist them with data, If tho administrator 
wants something calculated thrco moro ways when you aro 
already calculating it two Ways, calculate it tho five ways, 
The ones they aro likely to use aro the other thrco ways. 

(3) Attempt to Identify problems of critical long-run 
importance to tho Institution, What typo of action you can 
help bring about onco you identify tho problems will vary 
from situation to situation. Thrco points should bo kept in 
mind. 

(a) Progress comes slowly, The torloise ts more 
likely to win than tho hare, 

(b) Have empathy for the higher level admini- 
strator. Remember, he is standing in front of a 
bigger fan! Or moro fans! 

(c) Even if you identify successfully problems 
which arc critical to the institution, there may bo 
very good reasons why nothing is done about them 
— at least, in the manner in which you would seo 
it done. An administrator cannot tako on too many 
issues at one time. Unfortunately, some adminl* 
strators want to take on as few as possible, 

(4) Attempt to offer alternative solutions or 
strategics. This is particularly important when dealing with 
people-problems. Although the alternatives may acem less 
desirable than the basic solutions, action which goes part 
way may be better than none, 

(5) J^ook down the road. Attempt to anticipate the 
turns and the potholes. The important thing is to anticipate 
and plan for the probable consequences before the decision 
is made, Next most important — get lead time in order to 
expand the institution's alternatives. 

Finally, remember that the important things will not 
require a complex Planning-Management System, but they 
will require both analytical and diplomatic skill. 



ERLC 



THE COMPARABILITY QUESTION: 
POTENTIAL U9E8 AND MISUSES OF DATA 



Adrian H. Harris, University of California, Los Angeles* 



Higher education has long enjoyed a measure of 
freedom from oxlernal accountability which is envied by 
(hose who arc outside tho system and probably not fully ap- 
preciated by thoso within it, This privlledged position Is 
now being penetrated on all sides by a variety of calls for 
accountability, usually In torms of specific data by which it 
is assumed that effectiveness and efficiency of operation 
can be determined. 

The fiscal crisis now facing most public and private 
educational institutions has not been the solo reason for 
this cry for accountability, though It has probably had the 
greatest impact, Students are more aware of what and how 
they ^re taught and are often heard calling for greater 
relevance, Many state legislatures are looking more closely 
at public higher education in their states In terms of its 
content and conduct as well as Its cost. At least one 
Governor is calling for faculty to increase teaching loads 
and tho general question of the continuation of the tenure 
system as wc know it today is being more frequently 
discussed, A major concern of all these groups is 
improvement of tho educational experience through greater 
student-faculty contact, — smaller classes, more acces- 
sibility to distinguished professors — and accomplishment 
of this at the lowest possible cost. 

The common approach to the analysis and resolution 
of these issues has been tc require more and more data by 
which complex systems can be quantified, summarized, 
and compared. This is understandable at a time when the 
consumer is increasingly concerned with getting the 
greatest value for his dollar, What is not fully understood is 
the extent to which such data, if not compiled and analyzed 
with the greatest care, can lead to totally inaccurate or in- 
appropriate conclusions. 

The purpose of this paper is to discuss, through 
actual examples, the difficulties encountered when at- 
tempting to make routine comparisons of data and to 
suggest how data comparison can be handled meaningfully. 
In so doing. I will also point out how such data can be 
potentially misunderstood and misused. It is not my intent 
to discount in any way the need for accountability itself, It 
is entirely appropriate that higher education should be ac- 
countable, albeit in different ways, both to those who 
benefit from its services and to those who finance its 



operations, There is also no question but that we will all 
benefit from such an efforl, provided that it is conducted in 
a responsible, informed, and conscientious fashion. 

The National Center for Higher Education Manage- 
ment Systems (NCHEMS) has now appeared on the scene 
to lead the field in the development of products intended to 
aid in tho reporting process. Unfortunately, there is a 
temptation to use the results of these efforts as ends to 
themselves. Such a cookbook approach can more often lead 
to inappropriate conclusions than to informed judgments. 
This is particularly true when the result is a single number, 
such as a unit cost figure, which once obtained can be 
easily misused unless there is a full understanding of what 
is being presented and how it can and should be used, 

Among the products developed by NCHEMS 1 are the 
Program Classification Structure which allows institutions 
to divide their programs into standard disciplinary units; 
cost finding principles which attempt to set standards for 
the determination of unit costs; RRPM (Resource Require- 
ment Prediction Model) which has been mistakenly 
assumed by some people to be a model to develop unit 
costs for comparative purposes — instead of its real 
mission as an Institutional planning model for internal use; 
and the Information Exchange Procedures project which is 
designed to attack the problem defined in Its title. Such 
models are valuable to an institution's internal 
management, decision making, and evaluation. The danger 
is in assuming that such techniques can produce readily 
comparable results when applied to different institutions. 

Problems 

Thus far I have dealt with the question of data com- 
parability in a general sense. I would now like to offer 
some specific examples of the problems Involved in the 
selection, definition, and analysis of data to be exchanged 
or compared. The examples are primarily drawn from the 
experience of a six-campus data exhange effort in which 1 
was involved for over a two-year period. The six campuses 
were all large state-supported institutions having broadly 
based programs of undergraduate and graduate instruction 
and research. In pursuing the initial goal of data exchange, 
we uncovered many unforeseen problems. 

The first difficulties in data exchange are defini- 
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tional, In our own effort wo spent countloss hours on tho 
task of understanding tho Individual uso of torm9 and then 
trying to produco meaningful decision rules on tho classi- 
fication of dale, 

A commonly used data clomcnt is tho full-hmo 
equivalent studont (studont PTE). In jur group, all in- 
stitutions but ono determined undergraduate student PTE 
by dividing student credit hours by 15; tho other used a 
divisor of 15.5. Of course greater variation will occur 
between institutions which have different requirements for 
graduation or different definitions of "normal progress." At 
tho graduate level the problem of student FTE is vastly 
more complicated becauso of tho differences in graduato 
programs and tho manner in which graduate education is 
conducted and credited. For example ono institution in our 
exchango did not attach any credit valuo to doctoral work. 
As a result of theso problems, wo finally agreed to let each 
institution uso its own method of calculating student PTE 
and to accompany data with a chart defining tho method 
used. Obviously, anyono using these data must fully 
familiarizo himself with theso definitions and understand 
their differences before drawing conclusions. 

A related problem is the need to determine whether 
student FTE should be aggregated by student level or by 
course level, Within our group, there was considerable 
disagreement on this matter. Some felt that course level is 
the significant determinant of workload; others fcit that 
higher level students create more workload for faculty 
regardless of the level of course being taken. An added 
problem was tho fact that one campus did not identify 
course level and thus could not provide data in this form. 
In cither case the choico can ha* - significant effects on 
data, particularly whon micro programs aro being 
compared, and thus the use to which the data is to be put 
must be considered in reaching a decision. 

Another definitional problem centered around tho 
differences in University calendars and the timo period for 
which data arc to be exchanged. Among our six-campus 
group it was found that some used a quarter system, both 
with and without a summer quarter; some used a semester 
system; and one used a trimester system covering tho full 
year. Because of these differences, we agreed to exclude 
summer enrollments from the academic year. Annual data 
must also be defined as covering cither a fiscal year, 
academic year, or calendar year. While student information 
is usually easily separated by academic years, financial in- 
formation cannot always be treated in this way. For 
example, the campus mentioned above which used a year- 
round trimester system encountered enormous difficulties 
in attmpting to exclude its summer component to make Its 
"annual 1 * data comparable with the other institutions. 

The results of our deliberations over these and a 
myriad of other problems of the samo nature were 
represented in twelve pages of definitions covering the data 



elements to bo oxchanged and spelling out institutional dif- 
ferences in dotail. Tho comploxily of meaningful data 
oxchango is well illustrated by this document, which may 
bo obtained by writing to mo, 

By comparison, tho second edition of NCHBMS' 
Data E/emont Dictionary; Student dovotcs 125 pages to 73 
data olomenls: their comments give lltllo idea of tho 
problems wo encountered and, of courso, this is only ono of 
fivo such dictionaries. 

Selecting Comparable Departments 

Our noxt stop in the exchange of data was 
identification of a series of academic units for comparison. 
Our initial intention was to select departments that were as 
nearly identical on all six campuses as possible rec- 
ognizing at tho outset that programmatic differences may 
create difficulties in interpreting tho data. Thus it was 
understood that, whilo most universities aro organized into 
schools, colleges, and dep?r nents, not evory field is 
represented at every Institution Furthermore, disciplines, 
departments or programs having the same namo may riot 
include the samo subject matter, This is an important 
problem which Is not readily apparent to the outside user 
of data. It is obvious that physics and English aro different; 
it is not so obvious that two departments called "English" 
may vary on different campuses. In our own group it was 
found that some English departments Included rhetoric 
and/or speech and some did not; thus English was rejected 
for comparison, Similarly, romance languages could not be 
usod because In some cases French was included and in 
others it was not, At UCLA, for certain historical reasons, 
our Department of Linguistics includes instruction in 
several exotic languages not covered elsewhere. Some 
campuses identify a separte Department of Computer 
Sciences; at UCLA, instruction in computer sciences is 
included within engineering and cannot be separated. On 
the other hand, the same program may be called by 
different names at different institutions; environmental 
science on one campus might bo ecology on another. There 
may also be differences between the way graduate and un- 
dergraduate programs are organized in some fields, After 
sifting through the known differences of this kind we were 
only able to select seven departments for inclusion in the 
initial data exchange, Later, when analysis of the data 
uncovered differences even among these departments, it 
was agreed to provide departmental profiles outlining the 
program and requirements for each, It was evident that 
even with careful preliminary screening for similarity, 
these seven departments also displayed a mixture of 
objectives, resources, and organization as they were 
represented on the various campuses. 

As we continued our efforts, it became increasingly 
clear that meaningful data exchange required a full under* 
standing of programmatic elements. Not only was it 
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nccossary to understand tho individual programs being 
compared, but the institution within which they wero set 
and tho entire system of higher education as well. Institu- 
tional priorities, and commitments, outsldo prossures for 
change, and oven national interests may all have an impact 
which is reflected in the data for a particular program at a 
particular point In tlmo, The individuals involved in this 
effort were all high-level administrators in their respective 
universities involved in institutional research and 
planning, In spito of this, wo Oi!en found that further in- 
vestigation was needed to supplement our knowledgo of 
programmatic and organizational differences. Imagine 
then, tho difficulties that would bo encountered by oven tho 
most consclent jus outsider attempting to analyzo our data. 

Results 

The final Step In this initial effort at data oxchange 
was comparison and analysis of the results. Many of the 
differences which were observed were explained by closer 
examination of tho programs being compared. Only a few 
of the many possible examples will bo discussed here. 

Ono measuro compared was an unweighted 
student/faculty ratio. In the case of ono department, the six 
institutions reported values of 11, 15. 15, 16, 17 and 34, In- 
vestigation of the differences here showed that the 34 was 
the result of misinterpretation of definitions, ai) occurence 
for which ono must always allow, On tho other hand, tho 
small number was associated with a new program; a new 
program might easily be expected to have a smaller 
student/faculty ratio due to pre-staffing, in order to cover 
the field, before enrollments have reached their peak. 

The student/faculty ratios in art departments were 
relatively consistent for all institutions oxcept one, which 
had half the ratio of the others. In this case the department 
showing the lower value placed a relatively greater 
emphasis on art practice than on art history. Thus, classes 
were required to be taught in small studio sections and 
more faculty were needed to staff them, This also had the 
effect of reducing the budgeted support per faculty member 
to less than half the level observed in tho other art depart- 
ments. A somewhat higher student/faculty ratio at another 
institution, resulted from tho high servico load associated 
with a "general undergraduate art requirement." 

!n some cases, a department showed a high number 
of graduate students per senior faculty. While on the 
surface this appeared to be a commendable use of 
resources, it apparently resulted from the production of 
very few doctorates over a number of years. If the present 
group of students received their degrees within a short 
period of time, the data would be sharply reversed. 

Similar situations occurred when support funds per 
budgeted faculty were compared. For physics, the results 
were especially interesting; the six campuses reported the 
following figures for this depa:tment: $12,000, $10,000, 



$5,000, $3,000, $14,000, and $11,000. Tho two campuses 
having oxtremoly low lovels of support per budgeted 
faculty in this case were associated with largo oxtramurally 
funded programs. On tho other hand, tho campus reporting 
$10,000 per budgeted faculty was also known to have a 
largo extramural program including a well-equipped radia* 
tion laboratory, yet it eld not show tho low support figure 
that might havo been expected. Our examination also 
showed that this institution's program was ranked first 
among all physics departments in tho country, 

At ono institution tho support level in law was forty 
percent above tho others. In this caso tho departmental 
budget included prevision for a law library: at tho other 
institutions (his was part of a separto library budget. 

Psychology departments having a strong clinical 
emphasis characteristically had support levels as much as 
twico as high as thoso emphasizing the social sciencos, 
Here four of tho campuses reported support per budgeted 
faculty at $4,000; the othor two reported $7,000 and $6,000, 
In the first caso of higher support tho department 
characterized itself as "having more of a laboratory sclenco 
than social scienco emphasis," The other was stated to be 
'associated with a large clinical program." In both cases, 
the higher figures were easily explained by tho costs 
associated with tho support of laboratories and special 
facilities, a reflection of programmatic differences. 

Programmatic differences can affect data oven when 
programs are aggregated by discipline, Another oxample 
compares disciplinary groups on two campuses of tho same 
university, For tho biological sciences on one campus the 
support per FTE faculty was recently reported as $16,000 at 
the other it was $12,000; however, the second campus 
includes a vigorous health scienco program which Is 
budgeted separately. In the same report the physical 
sciences on the first campus showed a support figure of 
$13,000, compared with $17,000 at the s'jeond. Here, the 
first campus benefited from a large externally-funded 
research facility. 

Implications 

The examples could go on indefinitely; the Implications, 
however, are clear. While many legitimate differences will 
be observed when data are compared among institutions, 
many other differences are created by conditions not 
directly related to the date element being compared. This 
was recognized by the RRPM-1 Task Force of WICHE 
when they stated in a resolution published on March 9, 
1971: 

Institutions of higher education differ widely 
among themselves. They have different 
approaches to teaching, different degrees, different 
requirements for the same degree, different course 
mixes within a single institution to satisfy the 
requirements for the same degree, different course 
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contents, different methods of awarding and 
Computing credit hours, different support acti- 
vities, different student/faculty ratios, different 
goals, and other differences too numerous to 
enumerated 

An understanding of these differences, and consequently 
any meaningful comparison of data, can only bo 
accomplished by persons intimately acquainted with the 
data collection procedures, the programs, the budgeting 
patterns, the organization, the objectives, and o**icr 
important characteristics of the institutions involved. 

One might think that the most meaningful 
comparison of data would be made in an unchanged 
environment at a single institution where various mea- 
sures are compared for the same units over a period of 
lime. Howovcr, such conditions never oxist. Even in the 
least dynamic setting, chango occurs and one cannot draw 
simple conclusions collected over time, On the other hand, 
given an understanding of tho system and of the 
significance of differences between units and of changes 
which may be occurlng, data comparison can be an 
important decision making tool for an institution. Inter- 
institutional comparisons are vastly more complicated, and 
must be undertaken only with the greatest understanding 
and care. 

Universities will continue to be faced with a 
multitude of requests for cost analyses and other data. So 
long as resources for higher education remain scarce, those 
responsible for their allocation will continue to look for 
information to help them with their difficult decisions. It is 
likely that institutions wilt also be required to demonstrate 
that they are using their resources in the most efficient and 
effective manner possible 

Unfortunately, many people feel more secure when 
their decisions are based on quantitative rather than 
qualitative information. However, where higher education 
is concerned, considerations of quality are (or should be) of 
great importance. While qualitative considerations arc 
usually understood to imply judgments that are more 
subjective than objective, there is no reason for them to be 
uninformed or capricious. In addition, it must also be 
recognized that evon when the end rotult is a number, an 
essentially subjective doclslon may have been made in the 
selection of the method for producing that number. 



Numbers are not magic. They do not toll tho whole story 
any more than a picture of one side of the moon shows 
what is on the other side, Numbers can, however, bo useful; 
If they are properly understood and interpreted they can be 
combined with other information to giv«t a reasonably 
complete picture, 

Wo cannot escape the fact that data will be collected 
and comparisons will be made, What we must seek to avoid 
is standardization and regimentation around formats and 
definitions designed by those far removed from tho system 
in an attempt to assure "comparable data." Ultimately, we 
will have to live with resource allocations and other 
decisions that may be based on such efforts. However, it is 
essential that higher education not bo reduced to tho least 
common denominator, 

We have found from practical experience that a 
number of conditions are absolutely essential to any 
meaningful exchange or comparison of data in higher 
education. At the outset, tho effort must be designed and 
undertaken with the full participation of knowledgeable 
individuals representing all parties involved. Sufficient 
particulars must be provided to allow rational accomplish- 
ment of the task. Specifically, they must seek to: 

Fully agree to tho purpose of the comparison and 

the use of which the data will bo put; 
Insure that the data to be collected are consistent 

with the expressed purpose; 
Define all terms explicitly and include detailed 

definitions with any data disseminated; 
Provide profiles of each program to be compared, 

including information on all aspects of 

program which may affect tho data; and 
Permit the providers of tho data to review tho 

results so that errors of fact or interpretation 

may be avoided. 
Obviously, this is an ideal and not every condition 
can be met in every case oven when undertaken with tho 
best of intentions. Hopefully, a better understanding of the 
problems and concerns discussed hero will help to 
establish a meaningful environment in which those 
involved In higher education and those to whom they are 
accountable can work together responsibly and 
responsiveiy. 



* Acknowledgment is due Miss Dee Cucnod, Miss Gertie Ewing, Mrs. Jeffrey Gilbert. Dr. Wayne Smilh. Miss Corrine Verhulsl 
(members of the UCLA Planning Office Maff) and other members of our data exchange group for significant contributions which lead to the 
production of this paper. 

a Publications describing each of th^sc items arc available from the National Center for Higher Education Manaficmcnt Systems at 
WICHE. P.O. Drawer P, Boulder. Colorado 10302. 

J The other data element dictionaries urc for course, facilities, finance, and staff, 
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« Kenneth I). Koose and Charles |. Andersen- A Rutin* of Gradual Programs, American Council on Education, WO. This institution 
was ranked first for Quality of Graduate Faculty und fiflh for Effectiveness ut Doctoral Program and in each case ranked higher than any of the 
other programs compared. 

1 Derived from 107273 University of California Uudgel, 

■ Appendix A of ' Report of RRPM Implementation a! UCLA. 11 UCLA Planning Office, September 1971. 



AN INFORMATION BASE FOR BLACK HIGHER EDUCATION 



/ames Welch, inst/tule for Services to Education 



Institutions categorized by tho U.S. Office of Edu- 
cation as developing, by tho mass media as Black colleges, 
and by themselves as historically Black colleges and uni- 
versities, have for many years carried out an extremely 
valuable societal funtion, This function is tho education of 
the Black youth of America. Such a function was tho as- 
signment of o young American educational society not 
quite certain of its destiny and unsure of its placo in world 
history. Consistent with tho impetuousness of youth, the 
conclusion which this young American educational sociely 
drew — as it related to the education of its Black popula- 
tion — was that Blacks required a separate educational 
experience. Thus, the evolution of the historically Black 
colleges and universities, 

Historical records, most of which arc buried in state, 
federal, and some college archives, reveal much of the 
progress of these Institutions. In recent years, howover, a 
significant effort has been launched by the presidents of 
some 113 of these institutions in the establishment of a data 
bank to contain facts and figures on their institutions. It 
was their wish that such a data bank, once constructed, 
would not merely function as a repository of historical 
data on themselves, but also as: (1) a model for individual 
institutions to utilize in fashioning an institutional research 
data base and (2) a central data source for educational his- 
torians and researchers studying the historically Black col- 
leges and universities. The effort referenced is the Tech- 
nical Assistance Consortium to Improve College Services 
(TACTICS), and an agency called tho Management 
Information Systems Directorate (MfS) of the Institute for 
Services to Education, Inc. (ISE) in Washington, D.C. 
Funding for the MIS directorate of ISE was provided by the 
U.S. Office of Education. Generally stated, TACTICS is to 
provide tho historically Black colleges and universities with 
a range of technical services which historically have not 
been within their individual financial ranges. Training in 
both workshop and seminar form are available in the areas 
of Admissions, Financial Aid, Recruitment, Cooperative 
Academic and Administrative Planning. Media Tech- 
nology, and Information Systems. The MIS directorate was 
assigned the responsibility of developing a data bank of 
some specificity and long-range usefulness which shall 
provido the participating TACTICS institutions with the 



capabilities cited abovo, Tho statements which follow shall 
put forth what MIS/1SB construed as being Implicit in this 
assignment, and what to date, has been developed as a 
result of such an assignment, The relevance of this de- 
velopment to the topic, "An Information Baso for Black 
Higher Edugation," should become apparent as tho discus- 
sion of Iheso developments unfolds, 

M1S/ISE Developed Information System 

MIS/ISE drawing on its staffs' experience, tho ex- 
perience of the executive and senior program associates of 
the company, advisory groups consisting of college presi- 
dents, technical personnel, and senior administrators and 
faculty from both within and outside of tho TACTICS Insti- 
tutions, designed and developed data baso approach which 
in their collective judgment would be initially useful for a 
college's institutional research, 

It was In the collective opinion of the various ad- 
visories that tho educational / administrative environment 
of a developing college or university would require, 
initially, a set of data elements, which, when properly mas- 
saged and interpreted, would ycild as accurate a descrip- 
tion as possible of an institution's internal status. These 
data elements, to yield such a description, should, 
therefore, encompass tho following institutional environ- 
ments: 

— Students 

— Faculty and Staff 

— Financial (Income & Expenditure) 

— Physical Facilities 

— Course/Program 

— Institutional Characteristics 

MIS, with the concurrence of the various advisory 
groups, recognized that there would be three basic 
problems in collecting data of this nature: 

A. Though many of the terms in higher education were 
familiar to persons in institutions of higher education, 
consistent definitions of these terms were not avail- 
able. 

B, Collecting data of such depth and detail from institu- 
tions which arc unaccustomed and/or not presently 
staffed to provide same, would require in most in- 
stances, major procedural and/or policy alterations on 



ERIC 



/amos Welch 



the pari of tho Institutions). 

C. initiating and implementing on !K office for Insti- 
tutions, tho largest percent of which havo no electronic 
data procossing (HDP) capability, would require 
unlquo staff capabilities on tho part of both MIS and 
tho participating Institutions. 

These thrco basic problems wero approached and 

solutions sought. 

Problems Associated with Data Base Development 

A Data Moments Dictionary was doveloped by the 
directorate along with members of the technical advisory 
group of MIS. This dictionary provides definitions, descrip- 
tions, and examples of some four hundred terms or words 
esoteric to the field of higher education. Tho rationale for 
tho development of this dictionary was to assist individuals 
in tho institutions participating in tho MIS/ISB program In 
surpassing the translation problems associated with In- 
consistent definition^ of words, terms, and phrases related 
to higher education. In almost every caso, new words or 
phrases wero not invited, but instead, tho most frequently 
applied and existing definitions to educational tt rr s were 
utilized. Tho U.S. Office of Education, the Americen Asso- 
ciation of University Professors, and the educational 
taxonomies in conjunction with USOE's HEG1S (H'gher 
Education General Information Survey) definitions wc,rc 
suggested and utilized. An additional function of the dic- 
tionary—with somo expansion — would be to function as a 
basis for the establishment of a ' lingua franca" for educa- 
tional researchers. Three dictionaries were mailed to each 
of the 113 TACTICS Institutions participating in the MIS 
program during its first year of operation. Tho dictionary 
approach, therefore, appeared to satisfy the first basic 
problem of inconsistency in educational terminology. 

Problems associated with the collection of detailed 
data on and In developing institutions .ver<? approached in 
two ways. First, agencies which historically have queried 
developing institutions were identified, and with the unani- 
mous support of tho presidents and chancellors of the 
TACTICS institutions were authorised to release all perti- 
nent data related to their institutions, to MIS/ISE. Once this 
data was collected and analyzed, it was determined that its 
content was inadequate to form the appropriate basis upon 
which could be constructed an IR function. Questionaires 
were, therefore, designed and developed to supplement the 
collected data and were mailed to the various colleges and 
universities. The two design requisites for these ques- 
tionaires. bearing in mind the problem of the institution not 
being geared to respond in any great amount of detail, was 
to; (1) develop a survey instrument which would be useful 
to the responding institution as a research profile of itself; 
and (2) provide an instrument which, when completely 
filled out* could be utilized as a guide for responding to 
questions on other surveys. 



An additional problem associated with data collec- 
tion was revealed through tho analysis of tho agency-col- 
lected data. Inconsistency in dcfintlon of terminology from 
ono year to tho noxt was tho most prominont problem, Tho 
most consistent baso was data gleaned from tho HEG1S 
(Higher Education General Information Survey) reports ad- 
ministered by USOE/Natlonal Conter for Educational 
Statistics. MIS, together with its advisors, determined that 
the most lucid data baso could bo formed by coupling tho 
HEG1S data with data collected through the separately ad- 
ministered MIS/ISE survey instruments. Tho MIS/ISE data 
bank, therefore, contains cfala pertinent to tho areas out- 
lined earlier In this section on 113 developing Institutions 
dating from tho present (Spring, 1973; back to Fall of 1965. 

It Is, with this base providing tho input, that MIS/ISE 
has developed an On-Line QUERY computer system useful 
to Institutions desirous of implementing an automated 
Information baso for institutional research and manage- 
ment information pUrpcscs. 

The Evolution of a System 

In the opinion of the MIS directorate it is inconceiv- 
able to believe that just because a set of procedures has 
been developed which may improve an institution's 
research operation, that that institution is able to perform 
all of tho required policy and procedural alterations neces- 
sary to accommodate it. To have, therefore, a system avail- 
able to colleges desirous of implementing an automated IR, 
tailored to their individual needs, and one which could 
more closoly conform to a developing institution's 
economic resources, was the undcrgirdlng approach to the 
solution of the third basic problem conceptualized by tho 
directorate — initiating and implementing an IR office for 
institutions, the largest percent of which have no electronic 
data processing, 

As of January 31, 1972, there were operatlvo 42 com- 
puter configurations in 36 of tho 113 TACTICS institutions. 
This statistic indicates that about 70% of the institutions 
participating in TACTICS had no computer capability. To 
develop an automated system for IR purposes in view of 
such facts required additional consideration. Such con- 
siderations included: (1) the overall IR and information 
management objectives of the various institutions: (2) the 
operating budget of the institution's IR office; and (3) the 
institutions aggregate staff capability. Based on these 
fundamental considerations, the remote-access, computer 
time-shared approach was construed as being the most 
appropriate for the largest cross-section of the TACTICS 
institutions. Given this decision, a model system was de- 
veloped and is now operative for use in the MIS Wash- 
ington, D.C. office. The model system is presently referred 
to as QUERY. 

The design and documented procedures which an 
institution may follow for the establishment of an insti- 
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tuttonally-basod QUERY System approach, therefore 
assumes access lo a computer facility via somo remote 
access dovlco — teletype or console keyboard, Somo 
advantages of an automated system t think would bo in 
order hero because non-technical people often concatenate 
computers with magic. The principal advantages of the 
r.ystcm being automated are: (1) a large data base could bo 
maintained; (2) the manipulation of the base would not 
require as many man hours as it would If it were manually 
massaged nor would the number and kinds of manip- 
ulations be restrained duo to their complexity; and (3) the 
construction and testing of various educationally valid 
economic models would not bo restrained either by time or 
complexity of models due to a proliferation of variables. In 
each instance, one quickly notices that the advantages of 
the automated over a manual system is the amount of time 
conserved and the elimination of human error due to the 
redundancy in the data manipulations, Whether an insti- 
tution requires repetitive data manipulations or time con- 
servation should be entirely their decision. Thus, the 
system being developed by MIS shall be available for those 
institutions requesting it. 

You should be asking yourselves. "How do these de- 
velopments contribute to the subject. "An Information Base 
for Black Higher Education?" My response Is this: 

First. The development of the Education Data Ele- 
ments Dictionary provides educators as well as researchers 
with a basic definitive reference for educational terms and 
phrases. 

Second. The design and development of a survey, 



which if properly understood by tho institution, would 
function as an institutional profile report internally aud as 
an cxlorno/ report on tho institution to MIS. Such a docu- 
ment U presently being utilized as Input into a data base 
for tho TACTICS colleges and universities. 

Third. Tho collection ot agency data (I.e., ISE. 
Higher Kducalion General Information fljrvoy, etc ) adds 
another historical dimension to tho information on tho 
TACTICS institutions which should bo extremely interest- 
ing when paralted with data gleaned directly from the 
colleges. 

Fourth. Given tho volume of analysis necessary to 
interpret the collected data, tho QUERY system was de- 
signed as a data organization and retrieval system which 
would enable a researcher to get to tho data required for the 
generation of institutionally useful reports. Such reports 
would be productive in assisting institutions to plot their 
progress over any particular time period. 

In Summary 

You should now begin to see how these develop- 
ments fit together. Seven years of data on 113 institutions is 
in one location, A system is being developed so that a re- 
searcher docs not necessarily have to be in that location to 
retrieve specific kinds of information. Tho files in tho 
system shall be so structured that if one institution wishes 
to develop such a system for itself it may Use tho developed 
system as a model, or if a group of institutions would want 
to create an 1R network, a system would be availablo. 
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lames H, Montgomery, /ohn /anney, Gerald W, McLaughlin, 
and David Sieg, Virginia Polytechnic Institute 



When an Institution becomes aware that disparity 
exists between its financial expenditures and resources, it 
must, if it is to remain viable, make preparations for func- 
tioning in the midst of such imbalances while simul- 
taneously initiating programs designed to rectify the 
situation. II Is just such a situation in which inctcjsing 



numbers of institutions of higher education now find them- 
selves. There arc, furthermore, strong indications that this 
trend will continue for the foreseeable future 

As an aid to discussion of this problem, a simplified 
system diagram is presented below. Included are the 
primary concepts involved. The problems facing adminis- 
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trators In higher education arc perhaps best treated In terms 
of three distinguishable. If overlapping, areas of concern: 
financial limitations, enrollments, and social responsibility. 
With respect to the first consideration, there is little argu- 
ment that institutions of higher education, both public and 
private, have simultaneously been confronted by spiraling 
costs and restricted funding. For publicly controlled Insti- 
tutions in the United States, the current expenditures per 
full-time-equivalent student (in terms of constant dollars 
for 1969-70) increased from $1458 In 1959-60 to $1896 in 
1969-70.' This increase, after correction for inflation during 
the decade, strongly supports the claims of administrators 
that costs have mushroomed, 

Sellers* Market 

The decade of the 60*s saw a seileis market for 
college faculty and staff which was largely tl c product of 
sharp enrollment increases and heavy spending on re- 
search. In addition, while opening fall enrollment for all 
students in all institutions of higher education more than 
doubled over the decade, other factors including inflation, 
rising faculty salaries, increased expenditures for student 
aid, theft, and destruction continued to boost costs. 2 3 

A comparison of the large universities of the 
seventies with institutions of twenty-five to thirty years ago 
indicates faculty spend fewer contact hours In teaching — 
at times larger classes compensated for this reduction in 
students taught, at times no adjustments were made. An- 
other trend has been a greater emphasis upon providing 
opportunities for disadvantaged students. As greater 
numbers of such individuals are enrolled, the average per- 
student costs tend to rise because of the larger expenses in- 
volved. 4 An equally important factor contributing to cost 
Increases has been thr growing emphasis upon advanced 
degree programs.* 6 On the average, the preparation of an 
advanced degree holder necessitates greater commitment of 
resources per student than do expenses associated with the 
bachelor-level degree. Another and continuing trend has 
been the acquisition of increasingly complex and ex- 
pensive equipment, particularly in research-oriented fields, 
Such needs are a direct function of the knowledge ex- 
plosion which has necessitated more sophisticated means* 
of data analysis, storage, and retrieval. This trend will level 
off only in the undesirable event that institutions of higher 
education, by failing to maintain modern facilities, begin to 
relinquish their position in the forefront of the knowledge 
explosion. 

In order to complete the picture regarding financial 
limitations, factors associated with ever-rising costs must 
be considered In conjunction with the stowing or stabiliz- 
ing levels of financial support which many institutions are 
currently experiencing. Both commercial and private 
contributions continue to be affected by recent recession as 



the following excerpt* indicate: 

Total corporate giving to education in 1970 
declined 9 38 percent to $340 million. About 80 
percent, or $270 million went to higher education,' 

In its most recent report on private gifts to U.S, 
colleges and universities, the Council for Financial 
Aid to Education found that last year (1970) tho 
first average annual decrease In more than a 
decode was registered.* 
While a modest increaso (6,5 percent) In total giving 
to higher education occurred In 1971, tho messago is clear. 
Philanthropic contributions to higher education woro 
becoming more difficult to obtain, 9 

At the same time, governmental support at both the 
federal and slate levels has become moro tenuous as the 
voting public, in part becauso of recent campus disorders, 10 
demands a closer accounting for its tax dollars. In addition, 
one body of thought contends that state governments have 
reached or arc approaching the limits of their capacities to 
support higher education, particularly in view of pressing 
and ever moro competitive demands for slices of the tax 
dollar.' 1 

The extent and severity of the financial crisis may 
best be demonstrated by an Illustrative example. The 
National Association of Stale Universities and Land Grant 
Colleges (NASULGC) recently stated that 14 of its members 
had reported operating fund deficits for the 1969-70 aca- 
demic year. 12 They further reported that 44 members had 
reported increases in their operating budgets of 10 percent 
or less, while a 10 percent increase was determined to be 
the minimum average requirement for matching the effects 
of inflation and enrollment expansion. 13 

Nov is this situation restricted to the university 
levels. A recent study has disclosed that many smaller, 
private colleges were showing operating deficits by 1969 
(1968-69) equal to 26 percent of the book value of their 
assets. 14 In a follow-up study, the author predicted the 
failure of as many as 100 of the institutions in the near 
future, given "business as usual." 1 * 

Another survey of 48 private four-year liberal arts 
colleges revealed that most were characterized by worsen- 
ing financial conditions with no help in sight. 1 * The re- 
searchers felt that colleges have experienced more inflation 
than the economy as a whole while producing only slightly 
more growth. 

In many Instances where colleges and universities 
h?ve continued to operate in the black, methods for sus- 
taining financial solvency have included tuition increases 
and boosted rates of admission rather than actual manage- 
ment improvement, 17 There are strong indications that such 
approaches, wherein the student is asked to pay for dis- 
parities between productivity and cost, are nearlng cx- 
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haustlon. 11 Another factor which must now bo faced results 
from tho declining birth rato between 1957 and 1988." Pro* 
Jectlons indicate that the college-ago population (18-24 year 
olds) will actually dcclino betweon 1980 and 1985,*° 
Furthermore, enrollments may be expected to slow* where 
thoy havo not already dono so, at a much earlier dato. ai In 
the fall of 1972, for example, tho percentage of high school 
seniors entering higher education, which had been rising 
for decades, actually declined. The prospects of actual 
declines In enrollments present a problem with which 
educational institutions havo rarely had to deal With tho 
exception of enrollment declines which resulted from tho 
graduation of veterans (about 1950-52) and declines 
attributed to enlistment in World Wars, enrollment 
pressures have mounted continuously throughout tho 
century, If projected decreases io cccur, and if capital 
investment expansions continue <it present rates, ono 
should not be surprised to see many institutions developing 
overcapacities at least in certain types of facilities by the 
1980's. Studies show the small institutions aro in many 
instances already feeling tho pinch for students. A survey 
of 431 private colleges for the period 1965-1972 indicated 
that even during this period of generally increasing 
enrollments, these smaller schools showeu declines in 
percentage increase. 12 

In terms of cost it might be expected that fixed costs 
will be maintained at current levels white variable costs 
will be proportional to facility utilization. It will be the rare 
institutions which can reduce and control fixed costs at 
rates commensurato with inpending enrollment declines. 

Break-even Analysis 

A simplified break-even analysis such as that pre- 
sented in Figure 2 represents tho fixed costs (PC), variable 
costs (VC), and total revenue (TR) lines. If one assumes the 
difficulties involved in reducing fixed costs rapidly in the 
face of enrollment declines and that given any level of 
inflation variable costs will not be reducible without 
damage to educational quality, the question for each insti- 
tution is whether its enrollment will decline below point E, 
Point E designates the "break-even" point between profits 
and losses. 

The third question which should be considered 
relates to the social responsibilities inherent in the role of 
higher education. While social responsibility assumes 
multi-faceted dimensions, this question asks to what degree 
an institution should monitor and align itself with demands 
for the specific degrees which it supplies. An institution 
which does minitor such demands for degrees should be 
able to ascertain what portion of the total market it can 
supply. Logically each discipline would endeavor to tailor 
the number of degrees granted to anticipated demands. 
Problems arise when such procedures arc conducted en an 
informal and non-systematic basis as is the case a\ some 



Institutions, and from tho competitive desiro of depart* 
mcnts to attract majors. The impending degree surplus In 
specific areas dictates that suca procedures need to bo 
formalized. In instancos whero a given discipline finds 
itself glutted with degreo candidates designated for surplus 
areas, even after accounting for tho effects of normal attri* 
tion and curricular switching, counseling and re-orlentatlon 
programs becomo doslrablo and necessary, Such a concern 
also has economic implications, for cxamplo in faculty 
staffing and in confidence of students and alumni in tho 
purposes of an institution. 

Tho discussion in this paper thus far has consisted of 
a rcviow of current and anticipated challenges facing insti- 
tutions of higher education now and in tho not so distant 
future. Tho second portion of tho paper suggests methods 
which have been oilher proposed or implemented in re* 
sponsc to the situations outlined. Again it may provo best to 
separate considerations into thrco primary areas: cost* 
cutting procedures; incomo producing methods; and mana* 
gerial actions, (Admittedly there is considerable overlap 
within tho three,) 

Perhaps the easiest area to subcatcgorlzo is cost- 
culling. This might then be loosely divided into tho follow* 
ing categories: selective cuts, across the board cuts, consoli- 
dation, rcadapllon, and the "swim or sink" approach, The 
National Association of Stato Universities and Land Grant 
Colleges has compiled a list of seven economy mcasuros 
which arc employed with varying degrees jf frequency by 
member Institutions. 31 Of these seven measures, deferment 
of maintenance, elimination of new programs, and faculty* 
staff cutbacks or freezes were found to be most frequently 
employed. Some of these involve stop-gap methods which 
can only erode the overall educational quality of tho school 
in the long run." 

The Academy for Educational Development, Inc. has 
compiled a list of somo throe hundred and nineteen speci- 
fic actions and approaches aimed at alleviating financial 
difficulties. » The list deals not only with cost-cutting 
methods but additionally cites several infrequently ex* 
plorcd alternatives in the area of income production some 
of which will be mentioned below. 

One method of cost-reduction receiving much atten- 
tion is to combine small, related departments. Such an ap- 
proach, it may be argued, eliminates needless dual costs 
and administrative replication, A more stringent approach 
also receiving attention is the painful but realistic elimina- 
tion of departments which have ceased to grow and have 
actually shrunk in recent years. 

Consortia represent anolher concept receiving in- 
creased scrutiny, 2 * Cost reductions can and do occur when 
contiguous colleges form alliances in offering courses, 
facilities, and services. Successful cooperative arrange- 
ments currently functioning in Washington, D,C, New 
Hampshire, Boston, and other areas attest to the benefits of 
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figure 2 
BREAK-EVEN DIAGRAM 




consortia. 

A related method which has long occupied a contro- 
versial position among faculty and administration alike 
manipulates so-called productivity ratios, such as that 
between student credit hours produced and full time 
equivalent faculty,*' Large lecture sections almost uni- 
versally are coming into more frequent use. "Work-study" 
or "special" study course offerings which allow for inde- 
pendent student research are also felt to hold answers, The 
primary villain is felt to be indiscriminate course prolifera- 
tion, 

While tuition increases and the assessment of 
various fees remain valid and realistic practices, revenue 
from them should not be viewed as an area of major thrust 
in the quest for balanced budgets. There remain realistic 
upward limits to higher tuition, especially in an era when 



the open door to education promises to become a reality. 
The expectation of higher income through enrollment in- 
creases is warranted only in instances where admissions 
and recruitment programs have been revitalized and co- 
ordinated in recognition of the keen and growing compe- 
tition. Since the problem of boosting Income sources may 
be expected to become even harder to solve, alternatives 
must be sought. Certainly large additions from federal and 
state governments should not be expected," 

One method of fund acquisition which has received 
much attention calls for investments which involve higher 
than traditional risks but which also promise greater 
returns.'* One contributor to (ellema's Efficient Col/ege 
Management listed among a college's diverse portfolio of 
investments federal housing projects, private subdivisions, 
motels, laundromats, and even a harness racing track. The 
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same author rotors lo the "small town banker approach" 
which seems lo characterize iho views of many directors of 
flnanco and boards of trustees." Anothor plan, the so-called 
Yolo Tuition Postponement Plan, permits students to delay 
payment of portions of yearly tuition in roturn for u per- 
centage of futuro Income over a specified period. A recent 
Item In ERIC echoes the familiar but true refrain that 
alumni remain a largely untapped sourco of funds, Tho 
author of It further asserts that trustcos might attempt to 
shouldor moro of Iho responsibility In Iho area of fund ac- 
quisition." 

Efficient Management 

Efficient management, tho third area for roviow, 
offors tho promiso of both the greatest frustration as well as 
Iho best hope for survival. Realism dictates that educational 
institutions anticipate an oxtended period of financial 
stringency. While funds in many Instances may stabilize, 
ono cannot expect demands upon thorn to do likewise Ac- 
cordingly* ono must strlvo to do moro, or at least' as much, 
with less* A most fundamental chango Is needed In tho 
concept of educational management. Whether one llkos it 
or nol, It appears that continued financial solvency will 
necessitate adoption of approaches analogous to methods 
employed by modorn commercial management. As much as 
ono may eschew concepts such as product deletion, for 
example, this perspective Is precisely what lies behind 
current emphasis upon priorities. Modern management 
techniques and methods should lcavo no area untouched 
by Introspection and analysis. Three primary areas with 
which management should concern itself have been out- 
lined by one author as follows: (1) careful analysis of tho 
relationship between the utilization of resources and the 
accomplishment of goals; (2) quest for maximum 
economics with minimum sacrifices in quality of educa- 
tion; (3) encouragement of rapid and flexible adaptation to 
changes In demands." 

The realistic rosponsc to point one above clearly 
Invalidates uso of blanket reductions. Yet. as tho following 
quotation Indicates, this proceduro Is popular. 

Across-the-board cutbacks (for instance, budgets 
lowered by 5 percent for all departments and 
schools), or a unlvcrsity-widc "freeze" on hiring or 
on raises, are the comming pattern. . , . Equity 
among divisions whose relevance to the 
university's main mission vaiios a great deal is the 
opposite of selective pruning. 33 
If across-the-board cuts arc nol the answers, priorities need 
to be established and each program individually evaluated 
in terms of these. Having done so one can confidently and 
justifiably reduce costs in less or nonessential areas. (It 
will not be easy, however.) 

The unifying thread to the suggestions which have 
been offered is the need for management by objective. In a 



tlmo of slrlngoncy such as currently oxists, it would bo 
beneficial for each university community to rcassoss its 
long-rango goal* and associated short-rango objcclivos and 
then to mako decisions based upon thoso objectives. The 
essential clcmont to each dally decision, such as the cost 
reduction discussed herein, is tho evaluation of its effect 
upon tho achievement of long-rango goats such that short- 
rango actions do not jeopardize the moro pcrvasivo goals. 

Tho procoss of evaluating and, If need bo, curtailing 
tho operations of an academic department In higher educa- 
tion Is analogous to tho product doletlon decision often en- 
countered by commercial enterprises, This approach is re- 
flected in two product decision proposals prepared on tho 
campuses of Connecticut and Mlnnosota. Tho ossenco of 
each of thoso proposals is a series of quostlons with cato- 
gorical answers which rclato a product's compatibility with 
and position among oxlsling product linos. Tho questions 
and their responses combino to form weighted groupings 
(for oxamplo, marketability and channels of distribution) 
which arc ovaluatcd to dctormino an index valuo. Levels of 
degree production and enrollment would enter into tho 
procoss as crucial variables. Such management techniques 
do not eliminate subjective decision making altogether, but 
they do provido a narrowed spectrum over which decisions 
aro to bo mado while providing uniform sets of criteria. 

The Objective 

Tho ultimate objcctlvo of this presentation is not to 
suggost specific techniques which might bo employed to 
optimize utilization of limited resources but rather to call 
for an overall plan of attack, hopefully beforo a crisis arises. 
In light of this objective, two useful planning documents, 
mentioned above as oxamplos of product decision pro- 
posals will bo briefly discussed. Tho first document is ono 
which was presented by the Long Range Financial Planning 
Commlttco of tho University of Connecticut to Us presi- 
dent. 14 Tho strength of this proposal is that it is oriented 
toward specific recommendations for improvement in areas 
which Iho committee saw as economically deficient. For 
oxamplo, in consideration of incomo and under tho title of 
internal pricing, tho committee recommended to tho 
Student Welfare and Scholastic Standards Committee that 
a fee for dropping courses after a certain point at the begin- 
ning of each term bo instituted. Similarly, the committee 
recommended to the Faculty Standards Commiltce a scries 
of ratios for use in evaluating fund allocations to depart- 
ments. 

The specific recommendations suggested in the Con- 
necticut document however, represent only part of tho 
importance of this effort. The importance lies in the fact 
that specific recommendations were made for specific 
bodies or individuals to act upon by a concerned group of 
faculty and administration, 

Another excellent budgeting-planning document has 
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been developed at iho University of Mlnnosota. 11 The thrust 
of the Mlnnosota plan was to design a budget to mako 15 
percent of the 1071*72 instructional funds available for re- 
allocation within the university over the period of 1972-75. 
As o part of this planning document, the Joint commlttco 
effort at Minnesota posed many penetrating questions 
under broad headings such as Uniqueness of Programs, 
Vitality of Faculty and Student Body, and Costs of Program. 
Thcso questions provided aress of concern from the general 
to tho specific within which decisions were to be made and 
actions undertaken, Tho areas ranged from tho breadth of a 
consideration of program effectiveness and redundancy to 
the depth of n concern about hidden costs relative to any 
particular program or department. Such questions, tho core 
of tho Minnesota plan, provide the framework for planning 
and budgeting at all levels in the institution, Tho same 
questions could be employed by any institution of higher 
education but would bo answered differently based upon 
tho goals and objectives of each. The final segment of the 
Minnesota plan presented actual goals in terms of per* 
ccntagc reallocation of funds for each year over the three- 
year planning period. For the first year of this three-year 
period, each budget unit was to reduce its budget by 6 
percent. The unit or the college could thpn mako proposals 
to retain half this amount (3% ) for new or renewed 
programs. The other 3 percent was reserved for use by the 



total University to support now programs, Horcln lies tho 
strength of tho plan, for the university began with a 
problom (financial difficulties), assessed Its organizational 
goals, developed a broad frcamowork for continual 
planning, and finally established objectives by which 
Individual actions should bo guided and evaluated. 

When one compares tho two documents previously 
discussed, the slmilatltlcs In planning processes become 
clear. Both planning documents resulted from tho reali- 
zation of a problem and tho development of specific actions 
to remedy It based upon organizational goals. Also, each of 
tho plans presented a unified approach to tho organi- 
zational problems rather than a piecemeal solution to 
results of an underlying problem. 

In summary, conditions aro cither present or upon 
the horizon which may retard financial growth, As indi- 
cators emerge which suggest a need to hold or to reduco 
budgets, tho most useful approach appears to by to make a 
thorough self-analysis as a basic for reorientation and 
imaginative plans for tho future. Limited measures such as 
do for ling maintenance or purchases usually provo Ineffec- 
tive over a period of timo. Moreover, cooperation will bo 
needed among the administration, faculty, and students in 
order to find the bost solutions whilo avoiding to tho oxtcnt 
possible loss of morale and effectiveness. Clearly, there 
will be a need to plan and to manago effectively. 
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UNIVERSITY IMPACT ON LOCAL ECONOMY 



Bernard S» Sheehan and Barbara Seredlak, University 0/ Calgary 



Universities influence their local economies by 
generating additional gross real goods and sorvices from 
institutional expenditures and personal expenditures of 
staff, students and visitors. A simple minimum cost 
methodology for delimiting the economic Impact of a 
university on its local economy is described and illustrated 
by Tho University of Calgary's impact on the City of 
Calgary for three fiscal years. 

Methodology 

Tho methodology includes a calculation of total cash 
flow into the local economy from four types of university- 
related expenditures leading to estimates of economic 
impact defined by local jobs and by earnings directly or 
indirectly supported by the university. The proposed 
methodology is structured to take full advantage of tho 
peculiarities of the local economy in order (0 minimize (ho 
cost and timo required to use it. Therefore, somo judicious 
adaptation may bo necessary when the methodology is 
applied to different types of local economics. 

Staff disposable income, net university expen- 
ditures, visitors' expenditures and student expenditures are 
initial local Income as shown in Figure 1, 

Local staff expenditures are assumed to equal staff 
disposable income. Such items as savings and privato 
expenditures outside of the city are assumed to bo offset by 
other income sources. Surveys which would esttmato 
leakages aro costly to produce and the net eftcct of this 
approximation is judged not to bo significant for the 
purposes of this study. 

Net non-salary university expenditures include non- 
salary operating, non-salary trust fund, and capital expen- 
ditures. The value of goods and services purchased by the 
university which flow in first-round expenditures Into the 
local economy is estimated 1 based upon tho assumption 
that payments to firms flow directly into the local economy 
in the first-round if the firm has a local mailing address or a 
local business telephone number. 2 

Expenses of non-local delegates to campus confer- 
ences are considered to represent the majority of visitors' 
expenditures. An estimate of per visitor total local expendi- 
tures is applied to the number of annual non-local 
delegates to campus conferences. 



Local expenditures per full. timo student aro based 
upon estimates from filos of univorsity financial aid 
offices. 3 It is assumcd-that full-time students if they arc not 
attending university would be idle resources or would be 
taking employment opportunities from somcono else 
making tho net effect nil. Also, it Is assumed that in tho 
absence of the university, students who live at home would 
have gono elsewhere to study and further that room and 
board expenditures of students living at homo aro tho same 
as those for students living away from hom^.< Tho student 
expenditure estimate (not including tuition) is multiplied 
by the number of full-time students. 5 

Expenditure and Income Multipliers 

Univorsity related expenditures within tho region 
crcato local Income, jobs and business Investment 
opportunities. The first-round incomo accruing (0 local resi- 
dents is partially rospent in businesses round after round, 
becoming an infinite geometric progression creating addi- 
tional incomo and employment. 

Expenditure income and initial income multipliers 
aro estimated based upon existing studies of various types 
of expenditures and regions with similar characteristics. 6 
Multipliers vary depending upon comparative reliance on 
imports, spending and saving preferences of residents, 
patterns of consumer spending, and regional industrial and 
business structures. Multipliers within the ranges of valuos 
determined by relevant studies are chosen as reasonable 
estimates to multiply by Initial income and university 
related non-salary expenditures within tho region. 

Employment Opportunities 

Universities support many lobs in addition to those 
on campus. These jobs are an indicator of the economic 
impact of the institution on the community. An estimate of 
jobs supported is obtained using the average of results of 
two methods. 

Method 1 — University employment is assumed to 
form part of the regional economic base which consists of 
those activities providing employment and income on 
which the local economy depends. This theory 7 premises 
that "nonbasic" jobs are generated through employment of 
persons in activities which form part of the economic base. 
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Figure 1 
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Sovcral osflmalos of the size of the multiple effect of 
additional basic employment have been made for various 
typos of expenditures and regions. Employment multipliers 
Within a region are largo* the greater its population and 
employment diversity, and the less its dependence on 
Imports.' A value for the employment multiplier may bo 
based upon studies of regions of similar size, diversity and 
Interdependence, and upon studies of similar types of 
expenditures. This value multiplied by full-time equivalent 
university cmployros yields an estimate of additional jobs 
supported by university wages and salaries. 

In addition, the non-salary operating, non-salary 
trust fund, and capital expenditures of the university 
support employment. Ratios of the value of construction 
work and wholesale trade to the number of employees 
within each industry are applied respectively to university 
capital and non-safary operating and trust fund nxpnn. 
ditures to yield Initial employment estimates. Average 
employment multipliers for contract construction and 
wholesale trade are estimated based upon studies of similar 
regions, and are applied respectively to these Initial 
employment figures. 

Method It — The number of local jobs attributable 
to the presence of the university may also be estimated by 
applying an "employment requirements coefficient." 
Coefficients measure changes in local employment 



associated with the average household dollar spent locally 
when direct and indirect production requirements and 
induced income effects on local production are taken into 
account,* a suitable range of the coefficient is suggested by 
Caffrcy and Isaacs In terms of man-years of employment 
por rlol/ac of university-related expenditures In local 
businesses. A coefficient which is chosen based upon 
criteria similar to those of the income and employment 
multipliers is multiplied by staff expenditures and univer- 
sity non-salary operating, non-salary trust fund and capital 
expenditures, 

Mathematical Statement of the Methodology 

The methodology is summarized algebraically In 
Figure 2. Equation 1 shows the calculation for initial 
business volume while income generated is given by 
equation 2. The two methods of estimating employment 
generated are given by equation 3. 

Estimating Trerd of Future Impact 

Assuming that university-related expenditures are 
proportional to full-llmo students, and that initial income 
multipliers in the projection year equal those in the base 
year, annual local income generated over succeeding years 
may bo estimated based on student projections. This 
estimate is likely to bo low if the local economy is expand- 



figure 2 
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equation 1 

B»W+h(T+C)+fV + gSR 
In which: 

B m Initial local business volume 

W m disposable Income of faculty and 
staff less that of faculty on leave 
h « toeat disbursements 
total disbursements 

T a non-salary operating and non-salary 
trust tuna expenditures 

C a capital expenditures 
f a per visitor estimated local 
expenditures 

Ve number of conference delegates 

g * per full-time student estimated 
local non-tuition expenditure 

S a full-time students 

R e revenues from university 
facltitles 



Equation 2 

l«aW + fl(B-W) 
in which 

I a local Income generated 
a »= estimated initial Income multipliers 
O a estimated expenditure-income multiplier 
Equation 3 

Ji « K (E + mhC + nhT);Ji « E + p {W + h (T + C)} 
In which: 

{« a FTE Jobs using Method I 
h a FTE fobs using Method li 
X o estimated employment multiplier 
E a FTE faculty and staff employed by university 
m a FiT co nstruction employees 

value of construction work performed 
n a FTE wholesale trade employees 

p a employment requirements coefficient 
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ing because values of multipliers In the projection year 
lend to bo higher lhan those In tho base year. 

The proportion of local jobs supported in a given 
year may also be estimated by assuming that tho ratio of 
projected full-time students has o direct relationship to tho 
projected regional employment directly or indirectly 
supported by the university.^ An estimate of full-time 
equivalent employees within the region in the given time 
period Is used lo determine tho estimated proportion of 
local jobs supported by tho university, 

Discussion of Methodology 

The economic indicators of local income generated 
and full-time equivalent fobs created are not the only ones 
Which could bo chosen. 11 A balanced picture of the total 
economic impact of tho university on tho community must 
include many dimensions such as expansion of local credit 
bases, unrealized local business volume duo to tho univer- 
sity having its own facilities, the proportions and value of 
capital and property which relate to university-generated 
business volume, and local government expenditures and 
revenues due to existence of the university, Each of these 
factors arc Important yet require detailed analysis. Their 
omission limits the results and the significance of their 
omission must be Judged in light of the purpose of each 



application of tho methodology. Tho proposed methodology 
attempts to yield evidence of tho economic Impact of the 
institution on tho local economy to assist tho institution in 
providing un accounting fur iwuruuift piuvidud by guvurn- 
monts. Thus, local income generated and full-time 
equivalent jobs created seem most relevant for this 
purposo. 

Figure 3 shows tho income and jobs generated in tho 
City of Calgary by tho University of Calgary in 1968/87, 
1970/71 and 1971/72, Thus, as tho number of full-time 
students Increased from 4074 to 9173 the local income attri- 
butable to the university grew from $21 to 71 million and 
tho number of full-time equivalent jobs resulting from 
university-related activities jumped from 2850 to 7990, 

Needs of people whoso income and jobs are 
supported by the University of Calgary provide substantial 
marketing opportunities for local retail and service 
establishment, By assuming tjiat university-generated 
income will bo spent In a manner similar lo that of average 
Canadian families," distribution of local retail activity in 
food, housing, clothing, automobile, furnishings and other 
Industries can bo estimated, Figure 4 shows tho distribution 
of Income generaged by 1971/72 University of Calgary 
related expenditures into these sectors. 



Figure 3 
RESULTS 

IMPACT OF TME UNIVERSITY OF CALGARY ON THE ECONOMY OF THE CITY OF CALGARY 
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figure 4 

DISTRIBUTION OF LOCAL 1971/72 INCOME 
GENERATED BY 
UNIVERSITY OF CALGARY RELATED EXPENDITURE 




(MILLIONS OF DOLLARS) 



*Thc authors wish to express their appreciation to University of Calgary, for her contribution in the develop- ' 
Mrs. Margaret Reti, Office of Institutional Research, The ment of the methodology described in this paper, 



9 

ERIC 



Sheehon and Soreklak 



I This estimate does nut include Investments, bank transfers, travel expenditures, pensions, fellowships, bursaries, scholarships or 
student loans. 

' In order to minimise costs of d*h preparation, the ratio of local to total university expenditures calculated for ono lime period may bo 
assumed constant, and multiplied by capital, non-salary operating and non^salary trust fund expenses of succeeding lime periods to yield 
estimated JocaJ first »round university expenditures, 

J In the University of Calgary Illustration, a questionnaire calculated by the Student Affairs Office to a ten percent sample of fulHlmc 
students Verified the estimates of per student expenditure used. 

* This last assumption was tested with University of Calgary data to cstimalo the decrease in total students' expenditure If room and 
board expenses of students who live at home were not Included, Room and board payments less an estimate of the costs to families for thoso 
students were deducted, The difference in cash flow into the local economy was approximately three percent. Therefore* the extent of 
economic impact was not significantly changed, 

* University housing, food services centres and bookstore revenues are subtracted from the total cash flow because gross expenditures in 
university facilities arc included in university operating expenses. 

* Several estimates of expenditure-Income multipliers which may be applied to university expenditures are cited by John Caffrey and 
Herbert H. Isaacs. Estimating the impact of a College or University on the Local Economy (Washington, D,C,i American Council on 
Education, 1971), p. 44, 

9 Charles M. Tlcbout, "Tho Community Ecunumic Base Study," Supplementary Paper No. 16 (New York: Committee for Economic 
Development, December 1962). 

* fohn Caffrey and Herbert H, Isaacs, p. 44. City of Calgary employment Is approximately 1/5 in the manufacturing sector and 2/5 in the 
trade and service sectors. .Calculated from: "Estimates of Employees by Industry," Alberta Business Trends (Edmonton: Alberta Bureau of 
Statistics. January- December 1971 issues). 

v fohn Caffrey and Herbert H. Isaacs, p. 44, 

A sensitivity test was performed on this assumption using historical University of Calgary and City of Calgary data. The test yielded 
ratios only slightly higher than those calculated using this assumption. 

II Another university impact is changes in nearly relative real estate prices, A comparative analysis of residential lots and houses at 
various distances from the university was done, Ratios of selling prices to assessment values in close and distant areas were compared for 
houses with similar living areas and lot sizes. Tho analysis shows that the university may have Inflated selling prices of proximate homes. Tho 
location of The University of Calgary in a new section of a rapidly expanding urban region may make this observation peculiar to universities 
in (his sor^ of physical environment. 

" Dominion Bureau of Statistics, Urban Family Expend/lure, 1967. Catalogue #62-530 (Ottawa: Queen's Printer March 1971), p. 31 
{Edmonton pattern). 
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THE USES OF COST DATA IN INSTRUCTIONAL PROGRAM EVALUATION 



Robert D. Lamson, Booing Computer Services 



Higher education finds itself in a rapidly changing 
world In virtually all dimensions from the basic economics 
of financing to patterns of demand for programs of study. A 
leveling off and projections of actual decllno in enrollments 
from the "traditional*' 18-24 ago student group are being 
heard with Increasing frequency, A multltudo of now inno- 
vatlvo educational programs ranging from tho use of 
complicated multimedia technology to ihe University 
Without Walls" and degree by examination are being pro* 
posed and tested. Institutions find themselvos facing un- 
precedented financial hardships and many proposals for 
changing basic methods of support for posl-secondary 
education. Faculty and staff union organizational efforts 
arc increasing. Student tuition and other costs aro rising 
and student interest In administrative affairs is increasing 
at at least a comparable rate, 

The consequences of such dimensions of change arc 
well known to those concerned with management at insti- 
tutions of higher education: increasing pressures from state 
and federal agencies and from alumni for "accountability;" 
increasing pressures from students for "Relevance" (how- 
ever this may be defined); and increasing pressures from 
all funding sources for "Efficiency." The sum of all this is 
that the instructional process of programs, both traditional 
and new, are coming under pressure for review as never 
before. 

Instructional Program Reivew, an Economist's Approach 

I propose that the basic criteria around which tho re- 
view of any instructional program be built be that there is a 
demonstrable demand for the outcomes of the program. 
That is, the cstablishrncnt of a new instructional program or 
the continuation of an existing .one should rest upon evi- 
dence of a significant and reasonably consistent demand 
especially with respect to the next decade. 

There are two dimensions to this really very basic 
proposition; tho first concerns "student demand" and the 
second concerns the "social demand" or the needs of 
society in general. 

The most Important dimension must be student 
demand and for students it can be assumed the demand is 
a function of: 



1, Tho extent to which any educational program results In 
"certification" which Is not achlovablo in another 
program and which is necessary to achieve some post- 
educational goal (usually, but now always, employ- 
ment); or 

2, the degree to which the program is unique and offers 
an educational experience which Is strlcly for Its con- 
sumption value; or 

3, the degree to which the program provides important 
educational support or "service 11 to other programs 
which arc In great student demand. 

In assessing student demand it must be remembered 
that in all public Institutions of higher education, and most 
private ones as well, the student is required to pay con- 
siderably less than tho actual variable costs associated with 
his educational program. This Is due to tho fact that insti- 
tutional subsidies, whether derived directly from taxes or 
ultimately from "tax supported" endowment funds, result 
in substantially lower and generally more evenly distri- 
buted student-borno educational costs than would bo the 
case in an environment where all or most of the variable in- 
structional costs would be charged to the student. An ad- 
vantage of tho latter situation, which would certainly in- 
volve some significant student aid, is that the mere exis- 
tence of any program in itself would imply "sufficient" 
student demand. However* In the situation where costs to 
the student arc significantly below instructional costs and 
where the student-borne costs do not vary appreciably ac- 
cording to actual differences in instructional costs across 
educational programs, a different pattern of student 
demand emerges. Those programs which aro relatively high 
in actual instructional cost enjoy relatively higher student 
demand and those with relatively low .instructional cost 
have relatively lower student demand than the case in 
which student fees would vary in relation with differences 
in long-run variable instructional costs. 

In the former situation, without some review 
process, it would not be unexpected to find a larger menu 
of educational programs (some perhaps very small arrd 
perhaps high in cost), since there is not differential burden 
to the student for experimentation on the part of the institu- 
tion in offering small and/or specialized programs and con- 
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tlnulng even thoso which provo "unsuccessful" in terms of 
student Interest. In contrast, in tho coso where student costs 
arc directly related to actual instructional costs ono would 
oxpect to find no student demand at all for thoso programs 
for which size or somo other aspect carries unfavorable cost 
implications, and whero tho educational result of tho 
program, whether certification of consumption in nature 
could bo obtained almost as well In other lower cost 
programs. 

Evaluation of student demand should explicitly take 
this fact into account slnco, ceteris paribus, relatively low 
instructional cost programs would bo expected to oxpand 
and relatively high instructional cost programs would bo 
oxpected to Contract under a moro "normar*(ln tho econo- 
mic snese) pricing and financing scheme. 

Of course the dimension of public need or social 
demand is important since it Is presumably this on which 
any subsidy is justified. Any instructional program may 
produco useful outcomos which do not accrue to the 
student. Thcso arc generally said to be research or public 
service in naturo and such outcomes must be weighed in 
judging ultimately tho value of any instructional program. 
Evaluation in this regard should attompt to identify 
whether or not tho social outcomes vary in significance ac- 
cording to tho identified differentials In subsidy, composed 
of the difference between student-borne costs and actual 
instructional costs as discussed below. 

Another dimension which relates very much to 
student demand, cxpecially in tho sense of "potential" 
demand might bo termed program "effectiveness/' 

Three critical dimensions of effectiveness arc: 

1. Tho success of students who complete their educa- 
tional program (vis-a-vis those who do not) In achieving 
Somo post educational goal usually employment; 

2. The percentage of students who ultimately complete 
the program; and 

3. The average and variance around the avurago of length 
of time required for completion. 

The considerations of effectiveness aro important be- 
cause student demand as viewed in terms of numbers of 
students in any one time period represents only a snap shot 
of programs. Programs which are identical on a snap shot 
basis may be very different in the long term demand/effec- 
tiveness sense. 

These factors — student demand, social demand and 
program effectiveness should be considered in the process 
of evaluating instructional programs in higher education as 
it generally exists today, with subsidy schemes which 
lower and moro evenly distribute student-borne instruc- 
tional costs so as to alter the "natural" pattern of student 
demand. 

The Role of Cost Analyses 

How then does cost analysis relate to the very com- 



plox process of instructional program evaluation us dis- 
cussed abovo? I propose that thoro aro really Iwo rolos, each 
of which requires a different kind of cost information, 

Tho first rolo is to determine tho ranking of depart- 
ments on 1ho basis of what student-borno costs would be if 
derived on tho basis of actual differences In instructional 
program costs, What doos this mean? ll means that to evalu- 
ate tho oxtent of student demand for any Instructional pro- 
gram, tho relative "potential price" position of tho program 
In tho abovo senso should be considered and tho intensity 
with which evaluation criteria aro applied should bo in 
direct portion to tho potential prico ranking of tho depart* 
inent, That is, high priced programs should bo scrutinized 
more Intensely than relatively low priced onos In attompt* 
ing to assess: 

1. What [actors undcrlio existing student demand, to 
answer the question, "What would happen to student 
demand (increase decrease romain about tho same) if 
student tuition and fees wcro charged to reflect relative 
program unit costs,'* and 

2. Defining and measuring tho extent and valuo of tho 
social outcomes associated with the Instructional process. 

In essenco this amounts to "subjectively simulating" 
what would happen to program student demand should 
student-borne costs (prices) reflect program costs, and 
evaluating the price-reducing institutional subsidies on tho 
basis of tho oxtent to which tho instructional program ap- 
pears to produce significant social outcomes. 

The next question then is what costs should bo in- 
cluded in constructing relativo potential price rankings of 
instructional programs. Tho answer I feel Is relatively easy 
in concept but difficult in practice. Conceptually, the costs 
which should be included aro all long-range varlablo costs 
that would wind up being charged to students if they wore 
the only source of instructional^ related operating revenue, 
In practlco we arc talking about long run student avcrago or 
"unit" variablo costs. Wherever possible such costs should 
be computed on more than one year's experience to gain 
stability in the estimates and will include: 

Direct instructional costs based on course-related 
costs and an induced courso toad matrix to translato 
theso Into a student base for each instructional program; 

Allocation of all other variable costs associated the 
Instructional process, with the allocations on the basis 
most consistent with the nature of their variability (in so 
far as possible on the basis of actual user population); 

Allocations of quasi-fixed costs (i.e. fixed in the 
short run) Including an cstimato for annualized capital 
costs on a similar (user) basis or simply prorated 
depending on their nature. 

If in fact institutions of higher education Were to 
move to a full or proportional variable cost pricing policy, 
this is probably how in general student prices would be 
determined, Resulting potential price estimates must then 
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be "lntorprotcd" and Integrated in tho rovlow process with: 

Evidenco of program uniqueness and tho availability 
of "substitute" programs at the same or other institutions 
with a lower potential prico; 

Evidenco of tho apparent necessity of completing the 
program to rcceivo the educational benefits; 

Estimatos of the longth of llmo required for 
completion of tho program; and 

Definitive evidence which Is available concerning 
tho social outcomes of tho program, 

The results of a roviow which integrates information 
on demand, effectiveness and cost (In the potential prico 
senso) will generally bo tentatlvo decisions to expand, 
reduce, create or even In some instances terminate educa* 
tional programs. Once this state is reached a different kind 
of cost information is required to ultimately reach and see 
tho consequences of the final decisions, This is program 
related cost information, which Identifies the cost impli- 
cations of changes in tho activities of the various academic 
and other units within tho institution caused by tho chango 
in status of the educational program under review, Such 
program-related costs would include: 

Incremental course cost changes (if any) In the 
parent department associated with changes in the educa- 
tional program; 

Incremental costs in the parent department's Re- 
search and Public Service activities (if any) caused by the 
change in status of the educational program under 
review; 

Incremental course costs changes (If any) in other 
departments cuascd by a significant change in the "ser- 
vice load" impact of the new status of the program under 
review; 

Incremental Academic Supports costs (if any) cause. 1 
by such things as changes in the activity level of librarii s, 
the computer center or other such areas providing 
academic support to the instructional, research and 
public sewice activities of the institution; and 

Incremental Student Service (such as housing, food 
service, counselling, etc.) and Institutional Support (e.g. 
executive management, genera) administrative services, 
logistical services, physical plant operations, etc.) costs 
associated with changes in the status of the educational 
program under consideration. (Unless the program is a 
major one involving a large number of students, the 
Incremental impact upon institutional support is likely to 
bo minimal). 

The point to be emphasized Is that the kind of infor- 
mation required lo assess the resource impact of changing 
educational programs, either upward or downward, are the 
costs associated with the incremental changes in the vari- 
ous activities involved in or related to the educational pro* 
gram under review, This is not the student'based potential 
price (long-run unit cost) information described previously 



and useful for tho early stages of review in assessing tho 
significance and stability of student demand and tho 
relation of social outcomes of tho program to the implied 
prico subsidy involved, it Is very Important (hat theso two 
kinds of cost in/ormatlon not be con/used and used Inter- 
changeably and thus Incorrectly, 

The relovant incremental program-related cost Infor- 
mation is generally very difficult to dcrivo since ft requires 
among other things identification of: 

Where students In tho program Under review come 
from or go to with a major chango in program status, and 
what aro tho course academic support, student service 
and institutional support changes In lovel of activity 
implied by such a shift; and 

What is tho fixed/varlablo naturo of the cost associa- 
ted with those course or other activities so impacted (hero 
consideration may bo required of such things as tht 
tenure status of faculty and union agreements), 

There is no simple formula and a great deal of 
"judgement" is required in making such calculations. Also, 
it must be emphasized that "allocation" in tho traditional 
Sense* as associated with student based "unit costing" is 
not relevant, and only those program costs which can be 
identified as changing due lo a chango in the status of the 
program under review should be Included. 

Summery and Recommendations 

In summary the following points have been made: 

1. For the evaluation of educational programs in higher 
education today, there arc two kinds of cost information 
which are required. 

2. In the evaluation of student demand, program effec- 
tiveness and tho social value involved with the instruc- 
tional process pricing cost data is appropriate, This 
amounts essentially to long-run student-based variable or 
"unit" cost information, which includes allocations of all 
related costs including support costs, even those qhich are 
quasi-fixed in the short run. 

3. Once the evaluation of the program is made and pro- 
gram changes appear to be indicated, a different kind of 
cost data, INCREMENTAL PROGRAM COST information, 
is required to judge the resource impact of the potential 
changes. 

Institutions, state coordinating bodies or other agen- 
cies concerned wilh the evaluation of instructional pro- 
grams must have the capabilities to estimate both kinds of 
costs, and at a level of disaggregation v/hlch will not arti- 
ficially gloss over significant differences In cither potential 
prices or program costs. This requires the capability to 
calculate direct instructional costs both by course and by 
student as a base. It requires the capability to identify 
"induced" loads on a student major/course and instruc- 
tional program/department basis. Finally, it requires the 
ability and effort to identify the "nature of variability" of 
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Acodomlc Support, Student Service and Institutional 
Support costs as well as thoso related to tho Instructional 
departments themselves. 

There are no standard formulas or models which can 



replace judgement in such cost analyses. On tho other 
hand, tho proper dota baso and calculation capabilities aro 
required for informed judgement to be possible In the 
process uf Instructional progrnm evaluation. 



127 



A NEW LOOK AT TENURE 



Thomas M, Freeman and Joseph G, Rossmeier, Michigan State University 



Tenure, a term that suggests both sinecure and aca- 
demic freedom, continues to undergo scrutiny under the 
auspices of much publicity, In recent months almost every 
professional periodical on higher education has devoted at 
least one article to the subject of tenure, The Now York 
Times, the Wall Street /oufna/, and countless lesser known 
newspapers arc also carrying articles about the debate. 
There is also the proliferation of such books as The Tenure 
Debate, Tenure, Aspects of fob Security on the Changing 
Campus, and Tenure in American Higher Education that 
arc devoted entirely to the issue of tenure. On the local 
level many institutions (e.g., University of Utah, Wisconsin, 
Michigan State University, etc.) have spent innumerable 
faculty and staff man-hours on committees studying the 
nature of tenure. On the national scale the Commission on 
Academic Tenure in Higher Education, sponsored by the 
AAUP and thn Association of American Colleges, has just 
concluded a two-year study. Predictably, along with a few 
subtleties graced by conventional laments about the abuses 
of tenure, most analysis continue to wave the American 
flag with both hands while arguing for the survival of 
tenure with a few reforms, of course, on the ground that it 
is a necessary undcrgirding of academic freedom. 

Since the term tenure has already undergone its 
share of transplants, biopsies and, in some cases, even 
autopsies, this analysis shall refrain from further attempt- 
ing to justify the existence of tenure. Instead, wo will look 
first at several tenure trends in American higher education 
and, second, at several braodcr Issues in higher education 
which have the potential for affecting tenure. We will pose 
numerous questions as to whether current tenure trends 
can be supported in the future. Third, several solutions 
resolving the current tenure crisis arc offered, including a 
proposed new basis for analyzing tenure data. 

Current Tenure Trends 

The first question posed concerns whether rank 
distribution and tenure are currently at a dangerous level. 
For this analysis a "dangerous level" is defined as a situ- 
ation where fixed commitments of institutional staff re- 
sources have created inflexibility, with program change 
difficult and perhaps nonexistent. The Commission on 
Academic' Tenure in Higher Education (1973) recently 



stated that higher education is, In academic jargon, 
"tenured In;" others In recent months have called the 
current crisis the "tenure squeeze." In a very general sense, 
the Commission's report concludes that about half of the 
half-million faculty hold tenure, with tenured faculty rang- 
ing from 25 percent at some institutions to 80 percent at 
others, with most institutions tending toward the latter 
situation. 

Probably some of the more reliable position 
indicators of tenure trends are faculty-by-rank distribution, 
potential faculty eligible for tenure, and actual tenured 
faculty rates. Tenure is not always related in direct pro- 
portion to rank, therefore the percentages of faculty holding 
the rank of associate or, on occasion, the rank of full pro- 
fessor is not necessarily indicative of the actual percentage 
of faculty holding tenure, Three procedural circumstances 
are the cause of these discrepancies, First, some institutions 
award tenure to instructors and assistant professors upon 
reappointment after the successful completion of a pro- 
bationary or term period, Second, some institutions issue 
appointments to the top two ranks on a probationary or 
term basis rather than givo automatic tenure. Third, the 
base for the computation of the percentage of faculty on 
tenure varies considerably among institutions, 

Rank Distribution 

Aside from these cautionary limitations one can esti- 
mate, with a certain degree of accuracy, trends about tenure 
by looking at the rank distribution, For example, Table One 
Indicates the percentage of faculty members at the four 
basic ranks in iand-grant colleges and state universities for 
the years 1951-52, 1961-62, and 1971-72. From these data one 
can conclude that as the rank distribution of faculty moves 
from Instructor to professor, more faculty become tenured. 
Furthermore, one can assume, that since the percent of pro- 
fessors has increased by 6.5 percent, the number of tenured 
faculty has probably increased at least an equal factor, 

The trends which show the rank distributions of 
state universities and land-grant colleges differ somewhat 
from distributions of a more heterogeneous group of insti- 
tutions. For example, Trow (1973), in his large national 
survey of faculty in a random sample of over 300 insti- 
tutions in 1969, found the following rank distribution: 
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Tibte 1 

PERCENT OF FACULTY MEMBERS AT FOUR BASIC RANKS IN LAND-GRANT 
COLLEGES AND STATE UNIVERSITIES, 1951-52, 1961-62, 1971-72 



Rank 


1951-52' 


1961 -62 b 


1971-72< 


Professor 


26.7 


27.8 


33.2 




)47.7 


)52.1 


)58.2 


Assoc. Professor 


21.0 


24.3 


25.0 


Ass't Professor 


28.7 


28.4 


30.8 




)52.4 


)47.9 


)41.8 


instructor 


23.7 


19.5 


11.0 




100.1 


100.0 


100.0 



a) 68 Land-Grant Colleges 
20 State Universities 

Data from Faculty Salaries In Land-Grant Colleges and State Unive r sities, 
federal Security Agency, Office of Education, Circular No. 358, 19J 1-52. 

b) 57 Land-Grant Colleges 
82 State Universities 

Data from Salaries Paid and Salary Practices In Universities, Colleges; 
1961-62. Higher Education Series, Research Report 1962-R2, Research 
division, National Education Association, February, 1962. 

c) 57 Land-Grant Colleges 

40 State Universities which includes numerous state university systems 
such as Wisconsin, CUNY, and California, etc. Faculty data were taken 
from the "Annual Report on the Economic Status of the Profession, 
1971-72," AAUP Bulletin, 58 (2) Summer. 1972, pp. 201-233. 



Professor 25.4% 
Assoc. Professor 24.0% 
Total 49.4% 

Ass't Professor 30,5% 
Instructor 20.1% 
Total 50.t>% 

Evidently, the more graduate-oriented tho sample of 
institutions, the more likely the upper ranks will hold a 
higher proportion of the tenured faculty. This inference is 
strongly supported by figures In Table Two, which exhibits 
tho rank distribution of 1,244 institutions listed in the 
AAUP annual survey, the rank distribution of 130 graduate 
institutions included in the recent ACE study (Roosc and 
Andersen, 1970), and the rank distribution of the Big Ten, 



ail for 1971-72. Tho Big Ten, comprised of institutions 
which are highly graduate-program oriented, have the > 
highest percentage of upper-ranked faculty. 

Faculty Eligible for Tenure 

The trend of tenured faculty is also directly affected 
by the number of faculty eligible for tenure, i.e., in the 
tenure stream. 1 A current OIR tenure study at Michigan 
Stale University 2 shows that of 62 universities who re- 
sponded, faculty eligible for tenure in the four ranks in- 
creased 5.1 percent between 1970-71 and 1972-73, as shown 
In Table Three. 

Furniss (1972) found that of the 413 institutions he 
surveyed, 33.3 percent award tenure to instructors and 85.2 
percent award tenure to assistant professors. Shaw (1971) 
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Table 2 

COMPARISONS OF FACULTY RANK DISTRIBUTION FOR 1971-72* 



Rank 1,244 Instil. 130 ACE* Big Ten 

of AAUP 



Professor 


25.3% 


33.4% 


36.4% 




)49.8% 


)58.6% 




Assoc. Professor 


24.5 


25.1 


24.4 


Ass'l Professor 


35.6 


31.3 


27.9 




)50.2 


)41 .4 




Instructor 


14.6 


10.4 


11.3 




100.0 


100.0 


100.0 



♦Source: "Annual Report on the Economic Status of the Profession, 1971-72," AAUP Bulletin , 58 (2), 
Summer, 1972, pp. 201*233. 

* Lawrence Institute of Paper Technology, Peabody College, and the University of Delaware, are 
not included. Figures include the entire University of Wisconsin and the University of California 
Systems. 



determined in his study of 80 state universities and land- 
grant colleges that 46.3 percent offered tcnuro to assistant 
professors and 27.5 percent offered tenure to instructors, 
Awarding tenure to the tower ranks is not necessarily a 
recent phenomenon, for Pfinster (1957) learned in his study 
of 128 colleges that 34.4 percent award tenure to assistant 
professors and 44.5 percent to instructors. 

Faculty Tenure Rates 

Actual faculty tenure rates arc still the best indicator 
of tenure trends. Previous research also shows that in most 
institutions about half the faculty hold tenure appoint- 
ments; however, the range of variation is quite extensive. 
Shaw (1971) found that 52.2 percent of ranked and alt other 
instructional faculty in 60 state universities and land-grant 
colleges were tenured. Furniss (1972) concluded that over 
50 percent of all instructional faculty are tenured at 46.1 
percent of the public universities, 61.3 percent of the 
private universities, 34.2 percent of the private four-year 
colleges, 37.1 percent of the public four year colleges, end 
43.1 percent of all 413 institutions which responded, 

The current OIR tenure study of 62 graduate insti- 
tutions as shown in Table Three found that the number of 
tenured faculty increased by 9.7 percent between 1970-71 
and 1972-73. The number of tenured faculty increased 
slightly less than twice as fast as the number of faculty eli- 
gible for tenure and about a third faster than the number of 



all ranked institutional faculty over the same two-year 
period. Table three also shows that over the two-year 
period, in the upper two ranks, the number of ranked in- 
structional personnel increased by 10.3 percent, the number 
of faculty eligible for tcnuro increased by 9.2 percent and 
the number of tenured faculty increased by 10.6 percent. 
These figures indicate that faculty in the upper two ranks 
has increased approximately 10 percent for all three cate- 
gories (ranked instructional faculty, faculty eligible for 
tenure, and tenured faculty) during the last two years. 

Trow (1973) stated in his 1969 study of 27*191 faculty 
that tenured faculty were 51.0 percent of all ranked instruc- 
tional faculty (includes ranked temporary faculty); 52.6 
percent of ranked instructional faculty eligible for tenure; 
and 49.9 percent of total instructional personnel (ranked 
and non-ranked, including lecturers, assistant instructors, 
research associates, and specialists). Compared with Trow, 
the current OIR study, as showin in Tablo Four, found that 
for 1970, tenured faculty wero 55.1 percent of all ranked in- 
structional faculty (includes ranked temporary faculty); 59.8 
peicent of alt instructional personnel (ranked and non- 
ranked). For 1972, tenured faculty were 56.6 percent of all 
ranked instructional faculty, 62.3 percent of all ranked in* 
structional faculty eligible for tenure; and 47.2 percent of 
all ranked and non-ranked instructional personnel. 

The percentage differences between comparable 
categories of the Trow study and the current OIR study are 
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Tabic 3 

COMPARISON OF TENURED FACULTY BY RANKS DISTRIBUTION 
FOR 62 GRADUATE UNIVERSITIES 1970-71, 1972-73 



1970-1971 





I 

Instructional 
Faculty 1 


|| 

Faculty Eligible 
for Tenure 


III 

Tenured 
Faculty 




N» 55,208 


N- 50,847 


No 30,420 










Professor 


29.6 


30.6 


50.9 






2 




Assoc. Professor 


25 0 


25 6 


JUiV 


Ass't Professor 


31.4 


32.4 


10.8 






I"? J.O 


111 1 
J 1 «J« 1 


Instructor 

III Jll VI % v 1 


14 0 


11 4 


2 1 




1000 

■ VViV 


100 0 


100 0 

1 UviV 






1972-1973 






I 

N a 58,967 


|| 

N - 53,542 


III 

Na 33,375 




% 


% 


% 


Professor 


30.6 


32.0 


51.3 




)56.4 


158.3 


)87.6 


Assoc. Professor 


25.8 


26.3 


36.3 


Ass't Professor 


31.6 


32.1 






)43.6 


)41.7 


)12.4 


Instructor 


12.0 


9,6 


2.6 




100.0 


100.0 


100.0 




I 


II 


III 


Percent of Two-Year 








Increase for all 


(3759) 


(2695) 


(2955) 


Ranks 


+ 6.7% 


+ 5.1% 


+ 9.7% 




I 


II 


Ml 


Percent of Two- 








Year Increase in 


(3113) 


(2639) 


(2801) 


Upper Two Ranks 


+ 10.3% 


+ 9.2% 


+ 10.6% 



Included are temporary ranked faculty with pay. 
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Table 4 

PERCENTAGE OF TENURED FACULTY AT 62 GRADUATE INSTITUTIONS 
DEPENDING ON COMPUTATION BASE. 



Total 
Instructional 
Personnel* 



fy693 
66,010 



Total 
Instructional 
Personnel 'Who 
Are Tenured 



47.2 
46.1 



% of Ranked 
Instructional 
Faculty Who 
Are Tenured 

56.6 

55.1 



% of Faculty 
Eligible for 
Tenure Who Are 
Tenured 



62.3 
59.8 



4 Includes assistant Instructors, lecturers, research associates, specialists, 
In addition to all ranked instructional personnel. 



attributed partly to the institutions included in each 
sample. Trow's study concerned faculty from a cross 
section of higher education while the MSU study focused 
only on graduate institutions. Nevertheless, both studies 
indicate substantial differences depending on computation 
base to calculate the percentage of tenured faculty. The evi- 
dence also indicates here that tenure percentages are in- 
creasing steadily regardless of which coi.^utation baso is 
used. 

Even though the MSU study has derived its trend 
data on two years which are relatively close, one can 
assume that these trends tend to provide an overall picture 
of the tenure situation. From the trends shown in the 
current research and pointed out in previous research, tho 
number of tenured faculty is increasing at a rato (.5 to .7 
percent per year) which could easily lead to disastrous 
consequences in forthcoming years, 

Current National Issues Affecting Tenure 

In view of the current tenure trend, what are some of 
the current national issues which make a review of current 
tenure personnel policies necessary? First, the end of the 
military draft, higher fees and tuitions, and a phenomenon 
called "stopping out" by the Carnegie Commission are 
causing a dramatic slowdown in enrollment growth at the 
nations* colleges and universities. The 10 percent growth 
rates of the 1960s have suddenly shifted to a more normal 2- 
3 percent level, and probably will remain at the lower rate 



through the 1980's. 

Second, coupled with unparalleled enrollment 
growth during the 1960s was the growth of institutional 
budgets. Now, in a time of general financial exigency, 
many institutions arc finding themselves in a non-flexible 
predicament. Cheit, in his recent book, The New Depres- 
sion in Higher Education —Two Years Later, claims that 
the 41 institutions he examined in 1970 have since then 
"achieved a stabilized financial situation and have gono 
from a financial condition of steady erosion to one of 
fragilo stability/* The stabilized financial situation has been 
accomplished primarily through extraordinary cuts in ex* 
penditurcs that clearly cannot go on indefinitely. On tho 
other hand, in the past year legislators, as well as adminis- 
trators, have found that budget reductions, program 
cutbacks or re-allocations been mo next to impossible be- 
cause of tenured faculty. 

Third, severe pressures are being exerted on colleges 
and universities for increased accountability to a variety of 
agencies and interests including the general public, legis- 
lators, governmental agencies, the courts, coordinating and 
governing boards, faculty, students, and other internal con- 
stituents. Mortimer (1072) cites three applications of tho 
terrh "accountability in higher education:" managerial ac- 
countability, accountability versus evaluation, and account- 
ability versus responsibility. All three applications are 
relevant to the proportion of tenured faculty in an 
institution. 
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Related also to tho threo dimensions of account* 
ability is tho trend toward collectWo bargaining,* Will 
faculty bargaining units begin trading off concepts of aca- 
demic freedom and tonurc for pay incrcasos or reduction In 
work toads? Or will tenure bo bolslored as guaranteed 
security through collcctivo bargaining? 

Tho fourth issuo concorns longovlty of current 
tenured faculty, Milter (1970) claims that tho averago 
tonurcd position extends ovor a 35*year period, whilo iho 
averago nontenured faculty member stays only for seven 
years, Consequently, an institution has tho choice between 
ono tenured position or 10 nontenured positions over a 35- 
year porlod. Keast (1973) and Trow (1973) both claim that 
Within the last fow years about 75 percent of all faculty 
members were under 50 years old, and nearly two-thirds of 
tenured faculty were under 50. A lower averago age distri- 
bution will result in fewer retirements for the next ten 
years. 

Closely related to tenured faculty longevity is tho 
issue of ov jr-supply. Paced with a surplus faculty and a 
scarcity of availablo positions, institutions aro experiencing 
a decreasing turnover rate becauso employed faculty aro 
constrained by considerably lessened mobility, 

Thoso issues, when placed (n the concept of a no- 
growth faculty situation, exacerbato the movement towards 
restricting tenure. Certainly such conditions as declining 
rates of enrollment growth, dwindling financial resources, 
program reorganization, and fixed or reduced staffs should 
cause institutions to re-examine the current state of tenure 
affairs. 

Institutional Self-Examination 

National trend statistics are not as critical as indivi- 
dual institutional situations. In reviewing your own situ* 
ation related to tenure levels, consider the following ques- 
tions, Assuming current personnel practices regarding 
tenure will continue unchanged, will your institution be 
able to deal with tho following program factors: 

* future program shifts and new program development, 

* normal salary demands of faculty and staff, 

* extra demands of collective bargaining, 

* inflation and cost of living increases, 

* cutbacks in federal and state funds, 

* reversal gf out-of-state tuition clause, 

* higher (r c6st to retain tenure faculty (assuming that 
the average salary of a nontenured faculty is about 
half that of a tenured faculty member)? 

In addition to determining an institutional tenure 
rate and rank distribution, each institution must determine 
relative tenure rate and rank distribution for each college 
and department since percentages are not likely to be 
uniform throughout an institution. In fact, the situation is 
compounded if high tenure levels were found in declining 
programs, and not unlikely situation. 



Solutions to High Tenure Rates 

Up to now, most institutions havo not formally Insti- 
tuted any restrictions on tho number or percontago of 
tenured faculty, In tho 01R study of 130 graduate institu- 
tions, 13,4 percent of 82 institutions who rosponded Indi- 
cated thoy were considering imposing a quota limiting 
tenuro appointments. Furnlss (1972) found that only 5.9 
percent of 413 Institutions (all types) were actually limiting 
tho percentage of tenured faculty as of January, 1972, 

Solutions applied otsewhoro to tho problems stem- 
ming from too many tenured faculty includo tenuro quotas, 
equalized rank distribution, early retirement benefits, term 
contracts as opposed to a tenuro system, moro temporary 
appointments, appointments of now faculty only to lower 
ranks, and a general slowdown of tho rato of promotion. Of 
the procedures proposed for dealing with fixed commit- 
ment or tenure levels, somo results arc evident: 

a) Utilization of a package of benefits for early retirement 
doos not provido cost savings to tho institution but is appro- 
priate for improving tho distribution of faculty ago or rank, 

b) Appointment at a lower rank (instructor vorsus assis- 
tant professor) and Increased tlmo between promotions is 
effective In helping to sustain tenure lovels or to reduce 
them, depending upon its method and rate of application. 

c) Stanford University (Hopkins, 1972) found, that If ono 
of Its colleges made no additions to tenure whilo hiring 
new personnel and allowing for terminations, tho tenuro 
proportion would drop from 71 percent back to 57 percent 
in a ten-year period. Michigan State University would 
experience a similar kind of result. 

d) Term contracts in lieu of tenure havo not met with 
overwhelming favor by those studying tenure and alterna- 
tive systems. 

Ono key recommendation of the Commission on 
Academic Tenure in Higher Education (1973) Is to extend 
the probationary period to at least fivo years before tenure 
can be granted. Currently more than one-fourth of ail Insti- 
tutions have less than five-year probationary terms accord- 
ing to Furniss (1972). The Commission also recommended 
that tenuro quotas be expressed and utilized as "ranges or 
limits rather than as fixed percentages." 

Concept of Flexible Dollars 

Probably more important than any of the mechan- 
isms and procedures just given is the need for institutions 
to consider those factors pertinent to tho establishment of 
what Furniss (1973) calls "steady-state" planning, that is, 
planning when an institution has stopped expanding, 
especially in enrollments. The suggestion Is mado here that 
tenure percentages of committed positions, however com- 
puted, are not the critical factor in analyzing Institutional 
situations. Rather, tenure commitment calculations should 
be based on dol/ars rather than on positions. Tablo Five 
shows, that in a hypothetical situation where positions are 
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converted to dollars, a different picture becomes evident 
between dollar tenure commitment as opposed to position 
tonuro commitment because faculty in upper ranks 
consume more dollars per position than lower ranks, On 
tho dollar basis 64.60 percent of the total instructional costs 
is committed to tenured faculty. On the position basis 55.00 
porccnt of tho total instructional faculty is committed to 
tenured faculty, This illustrates tho point that unless one 
translates obligations (tenure, tenure eligible, and job 
security) into dollars tho appearances of low-tenured per- 
sonnel percentages can bo dangerously misleading. 

Derived from these comparisons is the concept of 
flexible dollars, which Is posed here as a better guide for 
management and planning in a steady-state situation. Flex- 



ible dollars are those dollars that are not committed be- 
cause of tenure, job security, or tho relatively fixed forms of 
financial obligations. Flexible dollars are dollars (or 
faculty) needed to accommodate student enrollment shifts 
among colleges and departments. 

It is important for an institution to retain in each 
budget a sufficient amount of uncommitted dollars for non« 
tenured and nontcnured-but-cligible faculty, so that posi- 
tions and resources can bo shifted to accommodate growth 
areas or provide for new academic programs, This 'nvolvcs 
applying a university SCH/PTEP average to all colleges and 
departments and then asking how many staff (PTEF) 
should bo shifted (added or subtracted) from each college 
t<> meet Instructional need. Tho shifts In faculty (PTEF) can 



Table 5 

A HYPOTHETICAL EXAMPLE OF POSITIONS VERSUS DOLLARS. 

FTE Positions 





N_ 


Tenured 
Faculty 


Percent of Total 
Faculty with Tenure 


Professors 


25 


25 


25 


Assoc. Professors 


25 


22 


22 


Ass't Professors 


25 


8 


8 


Instructors 


25 


_0 


_0 




100 


55 


55 



FTE Dollars 





N 


Tenured 
Dollars 


Percent of Dollars 
For Tenured Faculty 


Professors 


$550,000 


$550,000 


33.3 


Assoc. Professors 


450,000 


396,000 


24.00 


Ass't Professors 


375,000 


120,000 


7.27 


Instructors 


275,000 








$1,650,000 


$1,066,000 


64.60 
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thon bo derived and converted to dollars, from which a 
percentage figure of the tola) instructional budget is 
est I muted for each year. 

Hiring pcoplo nt a tower rank and/or ot u temporary 
rank would Improvo the tenure ratio and would allow for a 
ecrlaln staff flexibility; however, the question of dollar 
flexibility rather than position flexibility may be unwisely 
ignored under such a procedure Unless tho number of 
pcoplo on tcnuro or with tcnurc-liko job security is re- 
duced, tho institution's dollar flexibility has not improved. 
Holding toiisitml ihu level of lunured peoplo while increas- 
ing certain nontcnurcd faculty makes an Improved ratio but 
not necessarily an improved dollar situation. For oxemptc, 
consider a reduction in programs cutting into temporary or 
nontcnurcd personnel only, wliilo leaving tenured staff 
alono. This is an attractive approach but generally an un- 
realistic one for long-rango planning and management be- 
causo the long-range dollar flexibility Is further impaired. 
That is why some institutions have chosen to reduce entire 
programs, thus reducing fixed obligations. 

From the hypothetical situation in Tablo Fivo, 55 per- 
cent of tenured faculty translates into a dollar commitment 
of 60 to 70 percent of the operating budget. This table indi- 
cates that approximately 10 to 15 percent must be added to 
an institution s tenure personnel percentage figure to 



obtain actual dollar commitment or the relative amount of 
inflexible dollars. Tho question hero is at what lovel would 
the percentage of positions becomo dangerously high? Tho 
answer, of course varlos according to institution. Howovor, 
in general, a dangerous level is reached when actual dollars 
to support committed tenured faculty hinders tho institu- 
tion in coping with tho financial constraints spoken of 
earlier. A maximum level will also depend on salary lovcls 
and tho total position baso for computing tenure, If one 
Included other porsonncl in tho baso, such as graduate 
assistants and assistant instructors, then tho dollar factor Is 
enlarged. " 

Because of factors such as futuro enrollment levels, 
stato funding levels, degree of legal commitment to uni- 
versity personnel other than faculty, tho changing naturo of 
federal support, and external comparative data, one would 
concludo that for many institutions tenure levels and upper 
rank percentages aro very close to their maximum. Cer- 
tainly, it seems unwiso to allow commitments to grow 
much boyond current levels If an Institution is to bo abto to 
handlo any unknown futuro while retaining flexibility and 
Institutional vitality. One tho other hand, there is no 
current evidence availablo which readily encourages insti- 
tutions to reduce their pattern of commitments. 



1 Eligible for tonurc includes both tenured and non-tenured faculty, 
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THE TEACHING EFFECTIVENESS OF AN ALTERNATIVE TEACHING FACILITY 



Peter Horowitz and David Otto t University of Alberta 



To an increasingly greater extent we find 
ourselves being arranged by impersonal environ- 
ments in lecture halls, airports, waiting rooms, and 
lobbies . , , , The straight-row arrangement of 
most classrooms has been taken for granted for too 
long. The typical long narrow shape of a classroom 
resulted from a de9iro to get light across the room. 
The front of each room was determined by 
window location, since pupils had to be seated so 
that window light came from the left shoulder. 
However, new developments in lighting acoustics, 
ventilation, and flrcproofing have rendered Invalid 
many of the argumonts for the boxlike room with 
straight rows. (Sommer, 1967, p. 151) 

Many colleges and universities have sought to 
overcomo the rigidity of the straight-row" classroom in 
some of their teaching modules, but few have taken the 
trouble to see if these new teaching facilities have had any 
effect on the learning of students. 

In 1969, the University of Alberta General Faculties 
Council created a Committee to Investigate Teaching, This 
committee addressed itself to all facets of teaching, from 
physical models to pedagogical techniques, One of the 
projects undertaken by this committee was the designing of 
an alternative teaching facility. 

Three objectives were sought: first, to provide the 
maximum amount of versatility in intramural design and 
manipulation; second, to equip it with more visual and 
tactual stimulants than is normally found in conventional 
classrooms; and third, to study the effect of a lounge-type 
classroom on teaching and learning. 

Maximum internal flexibility was achieved in the 
following manner. Seats were portable half-hexagonal 
boxes which, when stood on edge, could serve as either 
Small work benches or waist-high partitions, Movable 
panels were suspended from an ellipitical bar on the ceil- 
ing. These panels could be strung out the full length of the 
ellipse, forming an egg shaped "womb", or could be com- 
pressed into a few feet, leaving the room open. Each panel 
could rotate 360 degrees, and could be held in place by 
means of a locked set of casters. Four banks of electrically 
charged rails housed incandescent pin lights. Each bank 
was controlled by a dimmer switch. Each pin light fixture 
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could be: (1) pointed at any locus on a half-sphero, (2) dis- 
mounted and moved to another electrical bank In the room, 
or (3) turned off. Each could hold a color filter. 

One could use these three elements, (scats, walls 
and lights), to create whatever kind of learning site was de- 
sired. For example, a class could begin with all students in 
a single campfirc type circle In the center of the room. 
When the need for buzz-groups arose, smaller groups could 
move to the corners, and the panels could function as 
screens. Or the class may sit on one side of the room and 
view presentations by students on the other side where 
half-hexagonal boxes could servo as a work area and the 
panels as backdrops. 

The Committee's second objective was to rekindle 
the learner's sensory awareness. Color and light were its 
first concern. Color was everywhere; the ceiling was mid- 
night blue; (he pin lights had red, blue, green and yellow 
filters; the carpet was dark green; the boxes were covered 
with orange and dark green carpet. Only the walls were 
left white. Natural sunlight entered the room either through 
the clear window pane or through translucent plexiglass 
sections in the wall panels. Because the pin lights were di- 
rectional and operated by dimmer switches, certain areas of 
the room could be flooded with light while other areas ob- 
scured by shadow. Other optical stimuli were present in 
the plexiglass, plywood and flberboard patterns in the 
panels. Tactile sensory input was provided by carpet on the 
floor and on the box-like seats. 

Varying geometric forms were available. Squares 
existed in the 4* x 4' panel inserts. Seats were half-hexa- 
gonal. These accompanied the usual rectangular outlines 
found in most conventional classrooms. The panels' 
pseudo-wall structure removed the slarkness of the right- 
angle corners. This elliptical shape developed a group 
seating which encouraged more eye contact among students 
while still maintaining Hall's (1968) Social Distance, 

A room such as this represents the antithesis of the 
Essentialist philosophy of education. There are no un- 
cushloned, straight-back, wooden chairs: no controlled, 
structured surroundings and no "bare necessities" which 
are the hallmarks of the Essentialists' frame of mind (See 
Wingo, 1965). "Sesame Street" has demonstrated that one 
does not have to indulge in regimentation and strict self- 
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discipline In order to team. Bui the question remains — do 
people learn more In a congenial environment? 

Research Design 

Wo hypothesized that learning occurs cither equally 
well, or even better in an Alternative Teaching Facility than 
In the more traditional setting. Learning was operationally 
defined as the scholastic performance, as evaluated by a 
competent grader, of two groups of regular undergraduate 
students' at the University of Alberta enrolled in two sec- 
lions of English 275 (Introduction to Prose), Scholastic per- 
formancc was measured by the letter grades, A-B-C-D-F, 
given to the students* two term papers and a number grade 
(1-9/ 9' is excellent) given on the final examination, 

These two sections were taught by the same instruc- 
tor (Horowitz) in two different classrooms: 289 Centra! 
Academic Building (the experimental setting) and G-114, 
Biological Sciences Building (the controlled setting). In- 
sofar as was humanly possible, the lectures and discussions 
in both classes were Identical, Mr. Horowitz met with both 
classes at every assigned meeting. The syllabus reading 
lists, assignments, term paper topics and final examination 
were Identical. 



A Graduate Teaching Assistant In the Department of 
English, was engaged to grudo the papers beforo Mr< Horo- 
witz read them. She was not informed of tho naturo of the 
experiment nor was she given any opportunity to interact 
personally with tho students. Furthermore, sho had no idea 
which studotns belonged to which section, as tho term 
papers and final examination wcro collected, when duo, 
into ono bundle and delivered to tho teaching assistant for 
grading. 

The Hanmon-Nclson test of mental ability was ad* 
ministered to the members of both sections during regular 
class time In tho term by Mr. Horowitz. 

The Subjects 

As this was a field study* tho effect of many vari- 
ables could not be neutralized. Wo were able to estlmato 
somo of their Impact, however, 

Results from tho Hanmon-Nclson tost inc :ato that 
tho two groups of etudents had essentially the samo level of 
ability, Eighteen of the original 29 students attended class 
the day the test was administered to the experimental group 
and 18 of the 32 were in the control class session the day 
following. 



Table I 

MEANS AND T-TEST VALUES OF THE VERBAL, QUANTITATIVE AND TOTAL SCORES OF THE TWO GROUPS 
OF STUDENTS (N = 18 EACH) ON THE HANMON-NEISON TESTS OF MENTAL ABILITY, COLLEGE LEVEL. 



r 



Variable 


Exper'l 


Control 


T Value 


Verbal 

Quantatatlve 


40.78 
21.72 


38.22 
22.39 


-0.88 
0.35 


Total 


62.50 


60.61 


-0.54 


(Maximum scores: Verbal, 60; Quantitative, 40: Total, 100) 
F Test differences of variances between these groups. 


Variable 


Exper'l 


Control 


F Value 


Verbal 


32.30 


118.07 


3.655* 


Quantative 


34.09 


29.66 


1.149 


Total 


50.03 


160.02 


3.199** 



*p<.01 **p<.025 
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Tho control group had a much wider rango of "in* 
tclligcncc," as measured by Ihis test, Overall, tho average 
scoro on tho verbal portion of tho tost was lower than that 
of tho experimental group but slightly higher on tho 
quantatativo portion. The Most failed to display any signifi- 
cant diffcrencos in tho Verbal or quantatativo recall of thoso 
two groups, Ono can conclude lhat the experimental group 
did slightly better in tho verbal area because it had a much 
smaller variance about the meen than did tho control group. 

The schools and colleges represented by these two 
groups of students were unmatched, Moro students wero 



from tho faculty of Arts and the school of Dental Hygiene 
in tho experimental group, whilo moro studonts from the 
facullles of Agriculture, Business & Commerco, Engin- 
eering, Pharmacy, Physical Education and Sclcnco wore in 
the control group, Tho bias, therefore tends to lean towards 
tho experimental group, as many moro Arts students were 
enrolled in the experimental group, 

Tho initial male-femalo registration figures, Tablo II, 
showed a distinct partiality towards the experimental 
group, 



Table II 

A 2 X 2 CHI-SQUARE MATRIX OF 
MALES AND FEMALES 



MALES 



FEMALES 



TOTAL 



Exper'l 
Control 



8 
19 



21 
11 



29 
30 



TOTAL 



27 



32 



59 



7,59 



df = 1 



p< .01 



The high number of females in the experimental 
group suggested a better grade achieving performance from 
that group. Carter. 1952; Edmiston, 1943: Maney, 1933; and 
Schmuck, 1965 have all demonstrated "iat female students, 
ceteris paribus, received higher grades than male students. 

There was no significant difference in the class 
standing (Freshman, Sophomore, etc) of the two groups as 
only ono individual in each group was beyond Freshman 
standing. In terms of age, no differences were noted. The 
average age of each section was eighteen. 

The control group had the preferred time of day 
(Tuesdays and Thursdays from i;00 to 12:30), while the 
experimental group met at 8:00. Mondays. Wednesdays, 
and Fridays. The room used by the control group was 
somewhat less desirable than even a typically traditional 
classroom in that it had no windows, a fairly low ceiling 
9 
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and a propensity for echo. 

A survey of these intervening variables indicated 
thai the members of the experimental group would have 
had a slight advantage over their counterparts in the control 
group. 



Results 

As Table III clearly shows, there were no diffetonces 
between the grades received by the Experimental and Con- 
trol Groups for the two term papers and final examination, 

The assumption that this alternative teaching facility 
is as conducive to teaming as is a traditional classroom can 
be supported, but the premise that tho facility is more bene- 
ficial to learning (as herein defined) is not supported, 
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TABLE III 

Chl-Square Comparisons of the Grades Given 
the Two Groups of Students Registered 
In Two Sections of English 275 
FIRST TERM PAPER 





EXPERIMENTAL 


CONTROL 




GRADE 


GROUP 


GROUP 


TOTAL 


A 


2 


1 


3 


B 


9 


11 


20 


r 

V 


10 


10 


20 


n 


5 


5 


10 


■ 


JO 


_1 


1 
1 


TOTAL 


26 


28 


54 


X* rt 1.46 


df = 4 


p< .80 






SECOND TERM PAPER 






EXPERIMENT 


CONTROL 




GRADE 


GROUP 


GROUP 


TOTAL 


A 


1 


2 


3 


B 


7 


7 


14 


C 


11 


10 


21 


D 


3 


3 


6 


F 


0 


_1 


1 


TOTAL 


22 


23 


45 


x 1 = 1.36 


df = 4 


p< .85 






FINAL EXAMINATION 






EXPERIMENTAL 


CONTROL 




GRADE 


GROUP 


GROUP 


TOTAL 


9 


0 


1 


1 


8 


4 


4 


8 


7 


8 


7 


15 


6 


11 


5 


16 


5 


4 


3 


7 


4 


9 


3 


3 


3 


JD 


± 




TOTAL 


27 


24 


51 


X* = 7.31 


df m 6 


p< .30 
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Discussion 

Wo do not feel that grades alone reflect nil lhat had 
occurred in both classrooms. (See Maslow & Miniz, 1950 
and Miniz, 1956). A number of differences were noted in 
the behavior of the seclions. As Iho term wore on, we no- 
ticed thai attendance was fur belief in the experimental 
class in spile of its being held al 8:00 a.m. The students in 
the experimental group were more ready much earlier in 
the term to participate in class discussions, and by late 
October, were actively debating quite freely among them- 
selves and with the instructor, ail of this with little urging 
from the instructor. Students in the control group, on the 
other hand, needed prodding throughout the term and were 
by and large content to sit silently through most classes. 

No observable differences existed between the stu- 
dents in either group on the dimension of receptivity to the 
material presented, but, as an example, half of one class 
session in the experimental group was devoted to exam- 
ining the reasons why tho class thought the book assigned 
for that meeting was "utterly boring." Students in the 
control group no doubt shared the same opinion of the as- 
signed reading, but no one thought to complain, 

We noticed more informality and group cohesion in 
the experimental group than in the control group. More of 
the students in the experimental group were addressing 
each other by first names, and this occurred between stu- 
dents registered in different faculties. In contrast, few 
students appeared to know, or even recognize, their class- 
mates in the control group. 

Finally, Horowitz reporis that visits during office 
hours were more numerous from students in the experi- 
mental group than from students in tho control group, and 
that during these visits, those from the experimenlal group 
seemed more at ease than those from ihe control class. 
During the second term (English 275 was a first term 
course) several of the students from iho experimental 
section continued to visit the instructor, who ncwr saw 
anyone from the control group again, 

Surprisingly, the cost of furnishing an Alternative 
Teaching Facility is close to the cost of equiping a tradi- 
tional lecture room. Room 289. Central Academic Huilding 
did cost more than it should, and more than Ihe traditional 
classroom does, but Ihis difference was chiefly due to mis- 
calculations in planning the pilot project and the need to 



rewire iho lighl fixtures, A second such teaching facility 
has been furnished in another building on campus. When 
the cost of the traditional furniture was deducted from tho 
$2,500 spent for reconversion, the next expense for the 
second room was approximately $1,000. Here, again, $500 
was spent In removing flourescent fixtures and installing 
incandescent lamps. It would be safe to estimate that the 
chief difference in furnishing a room such as 289, Central 
Academic Building in a building under construction would 
be the price of a carpet. 

Recapitulation 

An Alternative Teaching Facility was created in 
order to provide a more stimulating environment for learn- 
ing, The re&jJts of the students' work in tho cognitive 
domain, when measured in terms of the conventional 
system of grading, showed no noteworthy change, Informal 
interaction, both bclwcen students and between instructor 
and student, elements of the affective domain, did, how- 
ever, increase. 

One final comment. Within the last twenty years, 
psychologists such as Hebb have begun to explore the 
effects of sensory deprivation on human beings, They have 
learned that human subjects, when deprived of normal 
sensation for extended periods of time become bored, rest- 
less, mentally lethargic, and have reported an inability to 
engage in prolonged (hrought. (See AJtman, 1971; Heron, 
1957; Hebb, et al., 1954; and Vernon & Hoffman, 1956), In 
an effort to provide the maximum amount of space per 
capital budget dollar expended, administrators and archi- 
tects have continued using rectangular box-like cubicles 
with bolted down ranks of seats facing froni, in an environ- 
ment of bland monochromaliclsm, washed in uniform 
(shadow diffusing) flourescent illumination, and covered 
with sterile smooth-surfaced floor tile, (See EJechtel & 
Srivasiaba, 1966; Black, 1950; Cooper & Zubek, 1958; Kyzar, 
1971; Maslow & Mintz, 1956; Mintz, 1956; Reichert, 1973; 
Sommer, 1969; and Wotlon, 1970) 

We thrust our students into the environment and 
expect them to learn. In our opinion, creative, productive 
learning is not compatablc with ihis selling. 
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RESEARCH REPUTATION AND TEACHING QUALITY IN UNIVERSITY DEPARTMENTS 



Judy Richardson, Terry Eodo and John McMi'Jin, University of Washington 



Studies of the relationship between research and 
leaching h v<* provided little support for either sido in the 
ongoing debate of the relationship between teaching and 
research. Voeks (1962), Stallings and Singhal (1970), and 
Hayes (1971) all found no significant relationship between 
publication rato and student ratings. Only Brcslcr (1968) 
found a positivo relationship between research and 
teaching: at Tufts University, faculty who had received 
research grants received higher student ratings than those 
who had not. And the most recent review of exibUng 
research and opinion clearly presents the need for further 
inquiry (Page, 1972). 

Measure of Research Reputation 

This study differs from the earlier research mainly in 
that we examined (he research productivity and teaching 
quality of departments, rather than of individual faculty 
members. The measure of departmental research reputation 
was from the most recent American Council of Education 
Rating of Graduate Programs (Roose and Anderson, 1970). 
Since a department's A.C.E, rating is based upon a nation- 
wide survoy of scholars in that field, it is essentially a mea- 
sure of the quality and the quantity of research conducted 
by the faculty of the department. 

The daCa provided in the A.C.E. report enabled us to 
devise two systems for ranking University of Washington 
departments according to research reputation. In the first 
(or raw score) system* the departments were ranked accord- 
ing to the percentage of respondents who ranked the de- 
partment's faculty as distinguished and strong. The second 
(or percentile) ranking system was based on each depart* 
ment's relative rank among the other departments of that 
discipline across the country. For each of the seventeen 
University of Washington departments, we calculated a na- 
tional percentile score, and then the departments were 
ranked on the basis of this score, (Sec Table 1.) 

The difference between the two ranking systems is 
that in the raw scire system, University of Washington de- 
partments were co npared with each other directly, whereas 
in the percentile system, the departments were compared 
first with their field nationally, and then with the other 



University of Washington departments. The purpose of the 
percentile ranking system was to reduco possible dif* 
Terences in the generosity of raters among the various disci- 
plines, 

We also gathered departmental operating data, which 
served as additional Indicators of departmental research ac- 
tivity. This included (among other data) the percentage of 
faculty timo spent on research. 

Measure of Teaching Quality 

To measure teaching quality, wo designed a new stu- 
dent rating form. Since we wanted to insure maximum 
agreement on the meaning of a response, we employed a 
format of scale descriptors to aid the respondent. 

The choice of items was determined by our desire to 
keep the instrument short while accommodating two kinds 
of scales: those that measured the incorporation of research 
into teaching, and those that measured the generally-ac- 
cepted attributes of good teaching. The research-oriented 
scales were: Knowledge of Subject, Currentness of 
Material, and Use of Own Research. All of the research 
scales and most of the general scales wcro chosen from 
those that discriminate well between tho best and worst 
teachers (Hildebrand. et aL 1971). (See Illustration.) 

Sample 

From a list of individual programs of studies pro- 
vided by the Registrar, U06 students taking courses in the 
seventeen departments were randomly selected to receive 
the rating form. Returns were received from 58% of tho 
sample; therefore, our analysis was based upon 643 student 
ratings. To protect tho anonymity of individual instructors, 
the returned ratings forms were identified only by depart- 
ment and level of instruction. 

Results 

Using first the raw score ranking system, rank order 
correlations were calculated" between A C.B, ratings and 
mean student ratings on all items, and between A.C.E. 
ratings and mean student ratings on tho research items 
alone. The correlations were .16 (Yia) and -.07 (3ft) — 
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TABLE I 

RAW-SCORE, PERCENTILE, AND STUDENT-RATING RANKS 
BV DEPARTMENT 

STUDENT RATINGS 

ACE RAW SCORE RANK ACE PERCENTILE RANK RANK 





Department 


Percentage Who Rated 
Department Distinguished 
and Strong 


R 


X/E* 


%Ue 


IR 


y 


V 

JL 


H 


Geography 


58 


1 


6/34 


82 


2 


5 


3 


1 

G 


, German 


49 


2 


12/48 


75 


8 


8 


8 


H 
E 


Mathematics 




J 


1 ft /i no 

1 0/ 1 VI 


02 


2 


15 


lo 


R 


English 


39 


4 


12/92 


87 


1 


7 


12 




Sociology 


36 


S 


13/73 


82 


2 


\6 


7 


M 
1 


Anthropology 


29 


6 


16/42 


62 


16 


3 


4 


Physics 


25 


7 


20/113 


82 


2 


11 


14 


D 
D 


Chemistry 


22 


8 


24/125 


81 


6 


14 


13 


L 

E 


Psychology 


17 


9 


27/110 


75 


8 


10 


9 




French 


16 


10 


19/63 


71 


14 


1 


1 




Economics 


* 


11 


19/91 


80 


7 


16 


15 




Geology 


* 


11 


22/69 


69 


15 


2 


2 


L 

O 


Mechanical 
Engineering 


* 


11 


20/71 


73 


10 


17 


17 


w 

E 


Music 


♦ 


11 


18/43 


59 


17 


13 


10 


R 


Philosophy 




11 


19/65 


72 


13 


4 


5 




Political 
Science 




11 


21/74 


73 


10 


12 


6 




Spanish 


* 


11 


18/65 


73 


10 


9 


11 



♦These departments are in a score range placing them below French, but no percentages 
were given. They are listed alphabetically. 
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The following scale constats of qualities which Instructors may possess to varying degrees 
f !i??J*i e . tha , ? $tructor of ,h * H»«ed above on each the the qualities. Each quality 
is divided Into three sections, and each section Into three degrees, numbered accordingly 



from 1 to 9. In rating, cl 



tNTHVSiASM 
fORSOIItCT 



KNOWUOGl 

orsuijicr 



10URANCI 



CUMCNTNtSS 
Of MATIIUAl 



MISfNTATION 



AVAILABILITY 
TO STUOINTS 



US£ Of OWN 
11 SEARCH 



It definitely enthusiastic 4 bout 
matter of count. 



Definitely an expert; well-read and 
eipeHenced. 



Incoura$es and accepts widely differing 
points of *lew. 



Keepi course up lo dm; presents r«iw ( li 
of current reitirch or scholarship} 
Introduces Hill d«bjte*We Issues. 
1 1 



SJlmudlinf and eicllinf. 

J 2 



Is often ivjiljWe and easllv approached lor 
formal or informal contact In addition lo 
potted office hourr 



Comfifently Incorporatei own research Into 
count. 



Shows definite evidence of careful 
preparation. 



cle the number which best describes your Instructor, 



A. 



is et timei enthusiastic about tublecl 
matter, 



ln good command of luSject matter. 



Accepts views somewhat differing |:om hit 
own. 



Occasionally mentions current or recent 
research In the field. 



Seems to teach course without enlhuslnm, 

J! 8 l 

Unsure of subject mailer; not wellreid. 



Dbcourajei differing points of view; 
inloleranl. 



Course preparation could have been made 
years ago. 



_t_ 



J- 



Moderately Interesting. 

_4 $ 6_ 

Reasonably friendly; can be approached after 
class and during posted olfke hours. 



Occasionally Incorporates own research Into 
course. 



Puii you to steep. 
_2 



Resists student contact, rarely available 
after class; rarely keeps, or has no 
regular office hours. 



Utile or no evidence of Involvement fn 
reseirch. 



Shows some preparation. 



Not well prepared. 



both insignificant. Having found no overall correlation be- 
tween research reputation and teaching quality, we then 
compared departments by field of study. For the social 
sciences alone, we found a slight positive relationship be- 
tween A.C.E. ratings and student ratings on the research- 
oriented items. This suggested that for the social sciences, 
at least, departments with greater research reputation may 
incorporate research Into instruction more than those of 
tasser reputation. 

We next calculated the rank-order correlation be- 
tween A.C.E. ratings and student ratings, using the per- 
centile ranking system. This* time, we found slight negative 
correlations: -.37 (Xm) and -.56 (Xr). The negative corre- 
lation between national percentile ranking and student 
ratings on the research-oriented items was statistically 
significant at the .05 level. This suggested that those de- 
partments which had the highest relative rank in the 



country were perceived by students as incorporating re- 
search into teaching to a lesser extent than those with lower 
relative ranking. 

When the data were analyzed in an attempt to ac- 
count for this finding, we discovered that the major contri- 
butors to this negative correlation were the physical 
sciences. For example, Math and Physics were tied for 
second in percentile rank, yet received nearly the lowest 
student ratings on the ressarch-orlcntcd questions. 

This finding, together with the slight positive re- 
lationship found for the social sciences in the raw score 
ranking system, led us to conclude that there might be sig- 
nificant differences in the research-teaching relationship 
among the various fields of study as well as among depart- 
ments within fields. It is also possible that these relation- 
ships are obscured when all departments are combined to- 
gether for analysis. 
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Mean Sludenl Ratings 
All Items (X lmd ) 



Figure 1 



High 2.0 



3,0 



Low 4,0 « 



i ♦ • 
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12 



" l < 

18 24 



Percentage of Faculty Time Spenl on Departmental 
Research 



High 2.0 



Mean Student Ratings 3.0 
Research-Related Items (XR) 



Low 4,0 • 
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18 24 



Percentage of Faculty Time Spent on Departmental 
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Tho dtffcrcncos in the research-teaching relationship 
among various fields of study appear to be (ho result of 
three ma)or subject mailer differences, First, subject 
mailers differ in characteristic type of research (ranging 
from experimental to general scholarship) and in the extent 
to which incorporation of research into classroom instruc- 
tion can bo recognized and evaluated, For example, in tho 
social sciences, research is generally experiment! or des- 
criptive. Methodology Is stressed and studies are always re- 
fcrred lo by author, so it Is highly unlikely (hat a professor 
could refer to his own work without a student's being 
aware of it. tn literature or philosophy, however, students 
are unlikely to know whether an Idea presented by a pro- 
fessor came off the top of his head, from notes he took in a 
graduate seminar, or was the result of scholarly research, 

Second, subject matters differ in tho size of the gap 
between undergraduate and graduate level of understand- 
ing, For example, current research in psychology or 
sociology can usually bo understood by students even in 
introductory classes, whereas it would be very difficult to 
explain the latest research in physics to beginning physics 
students. 

Related (o this arc subject matter differences in tho 
size of the gap between the educational needs of the 
gencralist and specialist. Here again, the gap in the social 
sciences appears to bo smaller than that in the physical sci- 
ences, For example, tho latest research on cognitive dis- 
sonance may help tho freshman in a survey course to better 
understand his behavior, whereas the latest research on 
neutrons is of doubtful relevance to the nursing student 
taking a "service course" in chemistry. 

As a result of these findings, we feel that future 
studies of the relationship between research and teaching 
need to bo undertaken at the subject matter level, by 
specialists in that field working with specialists in institu- 
tional research. Such studies might compare departments 
across several universities. One of the less complex 
variables to examine is time. For example, in this study we 



examined by department the relationship between quality 
of teaching and the percentage of lime spent by teaching 
faculty in research, A negative correlation was found. As 
the regression lines in Figure I indicate, this relationship 
was almost identical for teaching quality as measured by 
tho means of all Ucms(JTt e)and that measured by tho means 
of the three research-related licms(J?R), 

Conclusion 

In closing wo emphasize the tentative nature of our 
findings and urge that more delicate and sophisticated 
analyses be undertaken. Some of tho factors to bo con- 
sidered have been suggested by this study. However, 
several additional considerations need to bo taken into ac- 
count in future studies of research and teaching. The first 
of these is the difference in kind of research that may bo 
undertaken. Basic research, applied research, and research 
on educational problems may all have different effects on 
teaching. 

A second consideration is that in order for research 
to have tx beneficial influence or. teaching, it is not necos- 
sary that cither research quality or quantity be correlated 
with teaching quality. Instead, it is only necessary that tho 
teaching quality of those engaged In both teaching and re- 
search be higher than It would bo, wcro they only teaching. 
Thus, rather than comparing teaching quality of faculty in 
the dual role, future studies might compare the teaching of 
university teachers with that of full-time teachers at other 
Institutions of higher education. 

Finally, given the subtle intcrdcpcndenclcs of re- 
search and teaching and tho adherents to doctinairc posi- 
tions for and against the present system of dual roles, great 
care is required in the presentation, interpretation, and dis- 
cussion of the results of future studies. Offending the 
sensitiveness of defenders of tho status quo might provoke 
unfortunate rcsistcncc to any Improvements that might be 
indicated as a result of such studies. 



A note of appreciation Is extended to professor Robert Cope who wrote the U.S.O.E, grant proposal and assisted In the analysis. 
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SEXUAL BIAS ANALYSIS IN HIGHER EDUCATION: 

AN APPRAISAL OF METHODOLOGY USEFUL TO INSTITUTIONAL RESEARCHERS 



Michael /. LaBay and Randolph N. Foster, Youngstown State University 



Overview 

We are now well acquainted with (he legislative his- 
tory of the "affirmative action" doclrlne of 1967. Introduced 
in ridicule by prominent Dixicrats opposed to the 1964 
Civil Rights Act, the doctrine took the form of Executive 
Order Number 11375 and stated in part that: 

... (A federal) contractor will not discriminate 
against any employee or applicant because of race, 
color, religion, sex, or national origin. The 
contractor will take affirmative action to ensure 
that employees are treated during employment, 
without regard to their race, color, religion, sex or 
national origin (Seabury, 1972, p. 39) 
The Dixicrats who introduced the word "sex" to that 
Civil Rights Act js an amendment never really expected the 
above executive order to be issued. As one contemporary 
writer has stated, the afterthought amendment was offered 
primarily "to rouse . . . Northern masculine ire against the 
whole bill" (Seabury, 1972, p. 38). 

A short time after the Executive Order was signed, 
however, the Department of Labor quickly offered further 
guidelines under Order Number Four which read, in part: 
... an acceptable affirmative action program must 
incude an analysis of areas within which the con- 
tractor is deficient in the utilization of minority 
groups and women* 1 (Seabury, 1972, p. 39). 
Thus, the above guideline became the first national direc- 
tive issued by a federal agency to universities concerning 
sexual discrimination allegation procedures on campus. 

It took little time for the Labor Department's direc- 
tive to be cited by the Department of Health, Education and 
Welfare (HEW) as applicable to university hiring and re- 
muneration practices. Executive Order 11375 quickly af- 
fected both public and private institutions of higher educa- 
tion. Columbia University and The University of Michigan 
obtained the unenviable distinction of being the first insti- 
tutions of higher education where unacceptable affirmative 
action plans were defined by HEW authorities (Zwerdling, 
1973). 

Most institutional researchers realized that, long be- 
fore the mandate of "affirmative action," universities have 
routinely reviewed their own hiring and remuneration 
practices. It is Simply not good administrative practice to 



omit such analysis. Both faculty rapport and fiscal account- 
ing practices rely heavily upon information secured 
through such studies. 

With the HEW mandate, however, these routine in- 
stitutional analyses emerged as a public as well as a private 
concern. Using Executive Order 11246, the Women's Equity 
Action League (WEAL) recently asked HEW to investigate 
alleged sexual discrimination throughout the State Uni- 
versity Systems of Michigan, New York, California, Florida, 
and New Jersey. Under fire from the Contract Compliance 
division of HEW, the University of Michigan has recently 
written the nation's first affirmative. aaMnrj plan of equal 
sexual employment opportunities. 

Other instances of anti-discrimination litigation and 
subsequent policy reorientation by colleges and univer- 
sities could be cited. It is enough at this point to simply 
state that, regardless of how today's institutional researcher 
perceives his function, he is fast becoming the dejure anti- 
discrimination fact-finder for his university. 

Statement of Purpose 

Something is wrong when a sexual bias allegation is 
easier to specify than is a related documentation method- 
ology. Yet this appears to be that state of affairs in many of 
today's universities. This paper will attempt to show that it 
is only when researchers have not had the opportunity to 
either define relevant stratifying variables on which hiring 
and remuneration practices are based, or when they at- 
tempt to use statistical analyses inappropriate to the deci- 
sions to be made that documentation becomes less efficient 
than the precipitating allegation. 

Let us begin with an examination of existing quanti- 
tative methods applicable to discrimination studies, follow 
with recommended investigative procedures deemed useful 
to institutional researchers charged with related analyses 
on their campus, and end with an example of one service 
remuneration study successfully conducted at Youngstown 
State University (Youngstown, Ohio) during the Spring of 
1971. 

Review of Available Methodology 

A reader performing a cursory review of existing 
literature will quickly find that few authors have written 
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specifically on the topic of higher education service 
remuneration policy and related post hoc analyses. Indeed, 
at Iho dato of this writing, HBW Itself has failed to pro- 
scribe quantitative methodology commensurate with their 
affirmative action guidelines, 

Today's administrative researcher must rely on 
specific methods at onco unique to his institution and ac- 
ceptable to affirmative action officials outside his organi- 
zation. Fortunately, an Increased coherence of research 
focus and procedures arc now beginning to be reported In 
the professional journals. Many reports appear, at first 
glance, to be so contcxtually distinct from each other that 
the degree of external applicability seems low, Closer in- 
spection, however, rovcals that contemporary analysis 
procedures havo evolved within a three-stage refinement of 
technique. Let us look briefly at those evolutionary trends. 

The quantitative theory of faculty selection and re- 
muneration procedure analysis seems to have been refined 
through three stages. Initially only an elementary quota 
model was used. Subsequent refinements to date havo in- 
cluded a second regression model and a third Baycslan or 
decision theory mode). 

The quota model applicable in selection analysis 
was undcrstandibly refined during the mid-to-lato sixties 
when American social conscience was most critical of mi- 
norlty oppression. Minority members were pictured as 
running a foot race with the majority. Track officials, 
noting that to stop the race, unshackle the American Blacks, 
then allow the runners to continue would still produce an 
unfair race providing the shackled runner with time to 
"catch up'* before continuance of the contest. 

With the acceptance of this analogy the quota model 
was tentatively accepted. Given this model it was a rela- 
tively simple matter for institutional researchers to define 
the presence or absence of sclcctivo racial or sexual bias by 
measuring the percent of qualifiablc minority applicants 
who were hired and promoted within their institution. If 
the percentage approximated the body count of minority in 
the population of all potential qualified applicants, 
minority repression allegations could assuredly be dis- 
missed. 

It took little time for officials to discern the short* 
comings of the quota model, ft failed to define adequato ex- 
pertise levels of potential candidates, and "tooling-up" the 
minority using majority guidelines was not as easy as some 
had anticipated. Articles questioning and belittling quota 
model use began to appear. On November 6, 1972, a Berke- 
ley Department Chairman was quoted in a national news 
weekly as stating: "We really looked for a qualified woman, 
but wc just couldn't find one" (Newsweek, November 6, 
1972, p. 114). At approximately the same time, Governor 
Milton Shapp (Pennsylvania) directed his state agency 
managers to recruit, train and promote as many women and 



other minority members as they could that year, but not to 
interpret his directive as representing a quota system. Ob- 
viously, even politicians were realizing that quota alono 
was not good enough. 

Other social critics voiced displeasure In quotas with 
selective training riders. Intellectuals of the Jewish faith 
emphasized that, since the Carnegie Commission on Higher 
Education had determined that Jews comprise nine percent 
of the faculty in the nation's population (as contrasted with 
three percent of the nation's population), the affirmativo 
action doctrine based on quotas and selective training man* 
dated that Jews stop running their own footraces until the 
more recently unshaklcd acquire identical training and pro- 
portional membership, With increasing frequency other 
critics voiced their opposition, and the quota model was 
quietly dismissed, 

In Us place emerged a second regression model, as 
typified by the studies of Locb and Fcrbcr (1971) and Astln 
and Bayer (1972). Multiple linear regression seemed, at first 
glance, to bo better suited to faculty selection and remuner- 
ation bias analysis than quota analysis. It necessarily in- 
cluded indices of expertise which the simpler quota model 
failed to define, and it directly related the indices to ac- 
cepted competency criteria. 

The multiple regression equations were based upon 
an extension of bivarlato linear analysis which produces 
prediction equations of the form: 

Y m Y + b(X-X) 

A 

Where V » predicted salary of candidate Yi for his ex- 
pertise level 

b ss regression coefficient of Y on X produced by 
differentiating with respect to X and setting 
it equal to zero. 

X m arithmetic mean of the X distribution 

In multiple linear regression, more than one pre- 
dictor (X) may be used to estimate the value of the criterion 
(Y). If Yi denotes salary remuneration of t individuals and 
Xii represents a value of the i 1h expertise predictor (e.g., 
years of service in the profession, terminal degree, number 
of publications, etc.) for the t ,h individual faculty member, 
the partial linear regression equation useful for obtaining 
the weighted sum of is: 

A 

Yi m ao + biXit + bkXwi 

A 

where Yt = is a predicted placement within a rank order 
candidate list or an existing faculty mem- 
ber's predicted salary 
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In the abovo equation, ao is a constant, and tho l)*s 
(bu..bk) oro doflned a*: partial regression coefficients and 
oro also constants. If the b's aro reduced to standard scores 
so that comparisons across expertise areas can bo mado, the 
resultant standard measure ((3's) arc known as standard 
partial regression coefficients. They aro useful to adminis- 
trative researchers in that they aro independent of original 
predictor units and may be used as an index of comparative 
weights each expertise predictor contributes to tho predic- 
tive power of the equation. When using the /3's properly, 
tho researcher defines the variance of a composite of n 
weighted predictors as: 

<r*v P b E/3>* + 2Z rij /3i 0i 
where cr*p ■ variance of a sum of n weighted predictors 

0 i ■» standard partial regression coefficient of the 
i 1h predictor 

rij a correlation between Xi and any other ver- 
where iable Xi where j> I 

ft i m standard partial regression coefficient of 
the j ,h predictor, with j> i 

Usually a multiple regression analysis produces a 
multiple coefficient of correlation (Ru i), which is derived 
in the analysis simultaneously with fi\ and bi generations. 
Like alt product-moment correlation coefficients, R indi- 
cates, the extent of relationship between t;vo interval or 
better measures linearly related. In salary studies, it be- 
comes the correlation between salary and the total collec- 
tive of stratified predictor variables consisting of the 
weighted sum of score generated in the /3 and b determina- 
tions. In geometric terms. R is the slope of the tetat squares 
line of best fit connecting these two variables of sup- 
posedly equal variability. Tho obtained R Is always a maxi- 
mum value when the regression weights have been cor- 
rectly defined, The terminal product of multiple linear re- 
gression analysis usually consists of a multiple correlation 
coefficient and prediction equation such as: 
A 

Y a 9600 + 200Xi + lOXa + 10Xa + 500X« 

In this ficticious example, if Y represented average 
salary of a predefined population and Xi..,X4 represented 
predictors properly represented by an interval scale and of 
approximately equal variability, the researcher could 
properly state that every unit increase in Xi (e.g., number of 
publications) is associated with a salary increase of $200. 

As in the case of bivariate linear regression, the 
above prediction equation has an associated standard error 



of estimate and related variance partitioning procedures 
useful In establishing confidence intervals and checking 
tho assumption that tho relation investigated is truly linear. 

As noted earlier, studies by Loeb and Ferbcr (1971), 
and Astin and Bayer (1972) used multiple regression 
analysis to investigate allegations of soxual discrimination. 
Loeb and Ferber's technique involved a proportioning of 
variance prior to regression analysis, whllo Astln and Bayer 
employed a stepwise multiple regression analysis directly 
on a multitudo of expertise variables, Both of theso studies 
are worth reading. Care, however should bo taken by tho 
reader in Interpreting somo results. Researchers acquainted 
with basic linear regression using least squares criterion 
and the general Hnear hypothesis techniques developed by 
Bottenberg and Ward {t9G3), will quickly see unwarranted 
data assumptions in both publications. 

Assuming for the moment that their assumptions 
were Justified, Loeb and Ferber reasoned that sexual dis- 
crimination existed if [he sex variable itself added signifi- 
cantly to tho predictability of salary after average match 
salaries have been used within the multiple regression 
analysis. They performed a sample survey, then matched 
faculty by department, rank, publications, degree, and 
academic honors, A routine regression analysis was per- 
formed using independent predictors, then a stepwiso 
multiple regression was attempted using sex-by-predictor 
indices. The two interactive indices ot strongest predictive 
power were found to be sex-by-merlt and sex-by- 
experience. The authors were abls to conclude after their 
investigation that: • % 

Papers read at meetings, honors, and if sex is 
known, bulletins and technical reports, and years 
spent at the University of Illinois at the current 
rank arc significant predictors of salary (Loeb and 
Ferber, 1971, p. 243). 
The authors then attempted to place dollar amounts 
on the degree of sexual discrimination, but found they 
could only use nonstandardized regression weight ratios to 
define the "average yearly dollar value of masculinity" 
(Loeb and Ferber, 1971. p. 246). In the authors own words, 
"the data (did) not clearly allow estimation of the 
magnitude of the discrepancies hetween the sexes" (Loeb 
and Ferber. 1971. p. 243), 

The Astin and Bayer Investigation concentrated on 
three criterion variables (academic rank, tenure status, and 
salary) and four sets of predictor variables (demographic, 
education, professional/work activities and employing 
institution). Analytic procedures consisted of routine step- 
wiso multiple linear regression, as cited in standard texts. 
The authors used a total of 33 predictors of salary and 
found that "64 percent of the variance in salary (was) ex- 
plained on the basis of the 33 . . . variables" (Astin and 
Bayer, 1972, p. 108). Another finding deemed significant by 
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tho authors was that: 

The Ihrcc most important variables In explaining 
salary differentials wcro rnnk, productivity and 
type of parent Institution (Astin and Bayer, 1972, 
p. 108). 

Significant predictors of academic rank were found 
to bo the doctorate, years in ucademo, and publications for 
both men and women, In considering rank as well as 
salary s Astin and Bayer added an additional demcnslon to 
their analysis with no appreciable change in analytic 
procedure, 

Like Loeb and Ferbcr, Astin and Bayer's concluding 
statements could only deal with such topics as explained 
variance between the soxes and significant predictors of 
promotion and salary within each sex. These types of state- 
ments obviously help discern if discrimination exists 
within a faculty group, but they do not allow an individual- 
ized study of faculty commensurate with Individual faculty 
discrimination allegations, 

There arc other disadvantages to using the multiple 
regression approach bosldes the inappropriate indices 
genorated, Tho technique always requires that* when 
alleged bias between two groups is studied, the predictor 
•variables chosen be complete in their definition of pre- 
existing group differences (Lord, 1967), have perfect pre- 
dictor reliability (Linn and Werts, 1971), and bo themselves 
unbiased measures of accomplishment (Thorndiko, 1971). 
In the opinion of Thorndiko, all of the three qualifications 
aro usually substandard when used In remuneration and 
placement analysis (Thorndiko. 1971). Add to these quali- 
fications the inflation problems associated with using many 
predictors to artificially raise a multiple R and the tech- 
nique becomes even more questionable. 

In summary, there is considerable evidence to sug- 
gest that the multiple regression approach is inappropriate 
for an institutional analysis of alleged sexual discrimina- 
tion. With reference to faculty salaries and promotion 
analysis, it is not specific to members within the group, it 
has a built-in bias when many predictors are used to 
generate the multiple Rs, the catcgores within the predictor 
variables themselves ara often not orthogonal, and the in- 
dices produced are not readily understood by the average 
affirmative action official, 

Concerning hiring practices, the fact that many ad- 
ministrators use predefined, multiple cutoff strategies in 
screening applicants further prohibits the use of the 
multiple regression general agreement that outstanding 
candidates possess areas of expertise for which there is no 
substitute. Candidates below minimum competencies in 
one criterion area are not generally defined as assets to a 
college, even if they are superior in other areas specified as 
predictors in the multiple linear regression equation, 

cening Committee members who eliminate candi- 



dates lacking essential skills Intuitively reject multiple R 
rationale In eliminating tho applications of Individuals 
who lack ono or moro essential skills or experience qualifi- 
cation normally Included as predictors of successful ac- 
complishments In acadomo, administrators reject tho 
foundation of regression analysis (tho selection of candl« 
dates with tho highest level of summallvo qualifications 
who may compensate on oxperliso credentials with ex- 
ceptional skills or experience in other cognatos) (Anastasl, 
1968). 

The best alternative approach for quantifying instilu* 
lional selection and remuneration of faculty appears to be a 
tool rosearchers havo had for a long time, elementary Bayc- 
sian and cross-tabulation analysis, Tho American Collcgo 
Testing Program's Research and Development Division* 
under tho direction of Melvin Novick. is currently tho most 
knowledgeable authority on Baycsian techniques as applied 
to selection procedures. It appears that simple, computer* 
assisted cross-tabulation of salary and promotional re- 
muneration based upon accepted expertiso variablos ts tho 
best techniquo for documentation In response to discrimi- 
nation allegations. Two references recommended for 
review of such method.?, arc (1) Sias in Selection (Colo, 
1972), and Statistical Packago for tho Social Sciences 
(SPSS) (Nie, Bent and Hull, 1970). 

Cole's research report first Introduces the reader to 
basic Baycsian considerations, then guides him through a 
brief history of selection analysis as interpreted through 
Baycsian theory. The analytic models considered, in order 
of complexity, Include the quota and regression models pre- 
viously discussed in this paper plus the Darlington model. 
The SPSS manual Is an extremely powerful computer soft- 
ware package that is readily adaptable to Institutional re- 
search work, 

All models discussed by Cole allow tho researcher to 
use quantifiable "priors" of his institution to predict 
changes of selection fur, candidates with predefined ex- 
pertise levels of competence. Although the bulletin is 
written specifically for admissions officers who wish to 
insure equal opportunity of selection based upon achieve- 
ment scores, it does provide a rationale useful for insti- 
tutional researchers. If a university has availablo a campus- 
wide format for screening applicants, many Ideas within 
the bulletin can be used directly. 

If screening procedures are less formal, one may still 
use Baycsian techniques to investigate alleged discrimina- 
tory hiring practices. The only requirement is that the 
number of potential applicants for a position and related 
existing conditions of current faculty of similar position arc 
known. For example, suppose that there is available a file 
or document which defines the proportion of female to 
male candidates graduating with appropriate credentials in 
the field of English. Let's arbitrarily state that this propor- 
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lion Is .35 to ,65 for females to males, respectively. 

Denoting mates by M and females by P for a random 
candidate, the probabilities associated with each sex may 
then be assumed to be: 

P{M]-,65 
P | F } - .35 

Noxt, suppose that D represents an instance of a dis- 
crimination allegation against an institution, if that insti- 
tution can, through a breakdown and cross-tabulation of 
qualifications, salary, and promotions of current faculty, 
determine an index of discrimination, judgements of prog- 
ress toward anti-discriminatory practices can be attempted. 
From the index, tho percent of M and F expected to be dis- 
criminated against if current policy continues can be de- 
rived, and a conditional probability statement can be 
defined. 

Suppose, for instance, that previous statistical break- 
down analysis indicates a mean difference of $1500 be- 
tween M and F English faculty after all relevent variables 
of remuneration have been controlled. Further statistical 
cross-tabulation analysis indicates that 75 percent of the 
females and 25 percent of the males were discriminated 
against, as defined by such salary differentials. In terms of 
conditional probabilities 

P| D| F ) - .75 

P( D| M ) - .25 

According to Bayes theorem, the probability that a 
female candidate will be hired if interviewed (that is not 
discriminated against when credentials are identical to 
male applicants) is: 



PI 


|D|F) P(F] 




PI 


[D1FJ P|FJ + P(D|M) P|M| 



" (■») (.35) 

- ( 75) (.35)+ (.25) (.65) 

- (.262)/ ((.262) + (.162)) 

- .111 



Without prior information of the extent of existing 
descrimination within the English Department, it would be 
assumed that the probability of a female being hired is .35. 
With selected "priors/* however, expectation of the female 
candidate is considerably reduced. 

Once a university has adequately analyzed existing 
promotion and salary indices, and have systematically re- 
viewed and defined criteria of placement and promotion, 
the institutional researcher should have little trouble using 
either the Baycsian or routine cross-tabulation procedures. 
There are only two restrictions associated with these types 
of analyses. The first is that all relevant criteria on all 
faculty must be known. Tho second is that only the most 
relevant and discriminating indices (between tho sexes) 
must be used in initial cross-tabulation work. Concerning 
the latter restriction, the number of variables used in 
alleged discrimination cases generally should not be greater 
than four. If this number is exceeded, it is likely that the 
number of empty cells in the initial tabulation matrix will 
prohibit further investigations. Pragmatically, it is difficult 
to discuss individual competencies with more than this 
number of qualifiers, and analytic procedures usually em- 
phasize the limitation of such conversions. 
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BIAS IN FACULTY REPORTS OF TIME AND EFFORT EXPENDITURE 



Patrick H, Sullivan, (Florida State University) 



This paper Is an extract from a detailed exploratory 
study Into tho bias associated with faculty self-reporting of 
time and effort. Tho parent study contains a substantial 
amount of statistical material not included here. It is the 
purpose of this paper to present a general discussion of the 
subject and leave the technical material to those who may 
wish to pursue it. 1 This paper, then, delvr* into Iho ques- 
tion of whether there is bias in faculty reports of time and 
effort and whether there is a pattern to any such bias. 

Background 

In order to put this report into perspective, let us re- 
view the circumstances which led to its preparation. In 
January. 1971. this writer was directed to determine how 
faculty members at the Florida State University divide their 
time among specified categories of academic activity. The 
purpose of tho project was twofold: First, it was to provide 
Information for impending legislative hearings and second, 
it was needed to produce baseline information for the up- 
coming program budget and six-year plan. 

A brief review of literature in the educational field 
revealed that although there were many studies on faculty 
time and effort, no substantive studios had been performed 
on the subject of survey methods for faculty time/effort re- 
porting. With the absence of such research, an attempt was 
made to determine how other universities were obtaining 
information on faculty effort distribution. Letters were sent 
to the directors of institutional research of tho forty United 
States universities larger than Florida State University, 
those forty offering tho largest number of doctoral degrees 
in academic year 1969-70. 

These tetters asked for information on how each uni- 
versity went about obtaining Information on its faculty's 
division of effort. Of the forty schools polled, thirty replied. 
Of that number, 16 required a faculty questionnaire. 5 ob- 
tained the information from department chairmen, and 9 
made no attempt to obtain tho information. 

The results of the poll Indicated that a mail question- 
naire was the common method of obtaining faculty 
time/effort information. These results led to a decision to 
utilize a questionnaire instrument to determine how the 
faculty at tho Florida State University divided Us effort 
among selected activities. This writer then constructed an 



Instrument that requested faculty Information required by 
tho university. This instrument utilized tho best concepts 
and approaches of each questionnaire received from tho 
other universities. The resulting questionnaire was distri- 
buted directly to each faculty member having a half-time or 
greater appointment. 

Tho writer then conducted faculty brictings and ln« 
stitutlonal meetings campus-wide on how to complete tho 
questionnaire. The reaction to the questionnaire itself, tho 
faculty concepts of tho reasons for it, their apprehensions 
about the uses or the misuses of the data, and their view of 
the process as a threat impinging upon academic freedom 
were revealed as real forces at work among tho faculty, 
These factors were seen to be significant and unavoidable 
forces impinging upon tho reporting process. 

Given these attitudes of fear and apprehension on 
the part of many faculty members, this researcher began to 
douht whether it is possiblo to obtain accurate and un- 
biased information on faculty activities through use of a 
questionnaire Instrument. In other words, it was felt that it 
would not be possible to accurately measure output of tho 
faculty resource. 

Contributing thoughts 

In a paper presented to the American Council on 
Education's 1959 Conference on Faculty Workload, Dr. 
Theodore Caplow recognized that there are an infinite 
number of ways to measure faculty toad, but all of these 
pose problems. The first problem, he felt, is that there will 
be cheating when faculty load is measured by an adminis- 
trative office. That this is so is not disreputable. It is a 
matter of general observation that whenever worker output 
is measured by employers there is some misrepresentation 
unless extreme (and in this case, Caplow felt, inappro- 
priate) caro is taken to verify the figures. 1 

In commenting on the deviltries of faculty load 
studies, Reeves and Russell made the following comment 
that provides an excellent summation of the situation. 
The evaluation of faculty load is an extremely diffi- 
cult problem, Teaching duties and other professional 
duties vary tremendously from institution to institu- 
tion and individual to individual within tho given 
institution. In fact, the factors involved In dotermln- 
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ing total faculty load arc so numerous and so varied 
as almost to preclude prcclso determination by any 
mechanical method. No thoroughly scionllfic 
method of measuring faculty toad Is now available. 
Existing measures uro unsatisfactory and incomplete, 
The answers are not yet in, Yet, as a practical necos* 
slty, some method of measuring and adjusting faculty 
load — even though approximate — must bo cm- 
ployed, 3 

While measurement of faculty output has been a 
consistent and continual problem in higher education fore 
number of years, there aro no significant difficulties with 
measuring the output of processes which are easily quanti- 
fied. Assembly lines producing automobile parts, electric 
components, 6-packs of Coca Cola, or cartons of cigarettes 
present no conceptual measurement challenges. Engineers 
have been ingenious In devising methods of measuring, 
wcightng, and otherwise assigning numerical values to the 
outputs of such operational processes. 

On the other hand, wherever an output or opera- 
tional result involves the human resource, measurement be- 
comes more challenging, The Hawthorne experiments gave 
evidence of this phenomenon. Under varying operating 
conditions worker output increased regardless of the chang- 
ing physical environments devised by the experimenters. It 
was determined that the presence of outsiders (the experi- 
menters) was itself affecting the performance of the 
workers, Studies since then have determined lhat cither the 
presenco of observers or the knowledge that performance Is 
being measured may have an inpact on the amount and 
typo of action taken by the person being measured, 

Hypotheses 

tn developing the methodology to attack the problem 
of examining whether (and to what degree) there is bias in 
reporting time/effort through the use of questionnaires, the 
following questions (hypotheses) were proposed: 

1. Is there any significant bias in reporting faculty 
time/effort on questionnaires? 

2. Is there any significant difference in reporting bias 
between academic ranks? 

3. Is there any significant difference in reporting bias 
between academic disciplines? 

Methodology 

With no existing studies to use as a baseline or point 
of departure, the research techniques described herein are 
exploratory in nature. That is, they attempt to determine the 
presence and pattern of occurrence of any bias in reporting 
on self-completion type questionnaires. 

An ideal approach to this kind of problem of deter- 
mining bias would bo to compare measured responses to 
known values. Since the known values did not exist, other 
procedures were needed. 



As an alternate methodology to the above, the fol- 
lowing was decided to be a satisfactory substitute, Truer 
values than thoso available through the questionnaires 
were used in place of the absolute known values. Thoso 
truer values wore obtained through use of another measur- 
ing instrument more accura.o than the questionnaire. 

A careful review of tho literature revealed that a 
diary Instrument, when used under carefully controlled 
circumstances, will provide more accurate information on 
time/effort than will a questionnaire, 4 

tt was therefore decided that tho test instrument to 
bo used to provide an alternate source of information on 
faculty time/effort would bo a diary log sheet* Faculty os* 
timates of time/effort were gathered using both question* 
nalre and diary instruments, In tho case of tho question- 
naire, faculty wore asked to estimate their activities for an 
average week during tho academic quarter* Tho diary 
Instrument, on tho other hand, was administered over tho 
course of tho quarter such that each respondent completed 
a diary on each of fourteen days? selected by a computer 
random number generator. For selected activities, the 
algebraic difference between questionnaire and diary esti- 
mates of a week's activities was obtained, This difference 
represented a measure of tho bias in tho questionnaire 
responses. 

Bias, a term used throughout this paper, is a syno- 
num for noise, anomaly, delay, or difference. Tho word 
"bias" carries with it no connotation of cither goodness or 
badness. It ha3 no connection with statistical bias, it is tho 
difference between tho real amount of time/effort devoted 
to certain activities and the apparent amount of time/effort 
devoted to thoso activities as reported through the informa- 
tion channel. 

Thus, the algebraic difference between a sample re- 
spondent's diary results and tho questionnaire's reported 
norm for that cell represented tho difference between the 
individual's actual activity and the estimated activity for 
individuals of that cell. The assumption was made that this 
difference represented a measure of bias and not the bias 
itself. Due to a lack of any previous developed technique 
for determining bias, this researcher felt justified in using 
the above measure. Further, It was hoped that the explora- 
tory nature of this research provided sufficient license for 
experimentation. 

In view of the foregoing, a sample of faculty diaries 
was obtained In such a way that it could be used for two 
types of tests: First, to determine whether the diary data 
were significantly different from tho questionnaire data, 
and second, to determine if it might be possible to detect 
significant differences in bias between academic ranks or 
academic disciplines. 

As for the activities to be measured, tho original 
questionnaire contained a number of candidates. Selecting 
the particular values to be studied from this list of candl- 



9 

ERIC 



157 



BIAS IN REPORTS 



datos required tho development of a set of selection criteria, 
A first consideration was that tho value (or param- 
eter) should bo clearly defined and not easily misundor- 
stood. A second crltorlon for selection of parameters was 
that thoy should bo common to all faculty. 

In ordor to meet tho criteria of botng easily under- 
Mood and easily quantified, actlvitios wcro defined In such 
a way 03 to bo consistent with tho faculty's perception of 
tho task, Measuring activities in the category "academic 
support" would not bo doslrablo sinco this represents a set 
of activities grouped for budgetary convenience and not a 
set of task performed by a faculty member, Thcroforo, a 
profossor might not find it easy to perceive and henco bo 
unable to correctly quantify his "academic support 1 ' acti- 
vities. 

It was thcrcforo decided to measuro instructional 
activities using both the quostlonnairo and tho diary. The 
activities measured and compared wcro; classroom teaching 
activities, individual instruction activities, and academic 
advising. 

Forty-eight faculty members were selected using ran- 
dom procedures within twelve pro-selected strata. These 
strata or cells were arranged to Include faculty from all In- 
structional departments. Thoso departments were divided 
into four academic discipline groupings: 

1, Professional Schools 

2. Social Sciences 

3, Physical and Quantitative Sciences 

4. Arts and Letters 

Within each discipline grouping four faculty of each rank 
wcro selected. An application of statistical processes to tho 
data gathered from these pcoplo allowed for the exploration 
of bias and its differences between ranks and between 
disciplines. 

For each of the forty-eight faculty members partici- 
pating in tho study, diary data wero obtained for no less 
than fourteen days during the Spring Quarter of academic 
year 1970-71. For each respondent seven sample days wero 
obtained during tho first five weeks of the quarter and 
seven more sample days fron tho last fivo weeks. Each of 
the two seven-day periods or samplo weeks for a re- 
spondent contained one Sunday, one Monday, etc., such, 
that each day of the week was represented. 

As each diary sheet was received back from a partici- 
pant, it was checked and the data placed onto computer 
cards, When all diaries were returned and the data 
punched, tho statistical comparisons began. The average 
number of hours per week expended in each category as re- 
ported on tho diary was algebraically compared with tho 
similar valuos reported on the questionnaire, The question- 
naire estimates were mado for an "average" week as de- 
fined by the individual faculty member, The differences 
between the two, called bias here, were subsequently oper- 
ated upon statistically. 



Findings 

Tho first quostlon to bo answored by this research 
was whethor thoro was any statistically significant bias 
prosont. A slmplo Student's "I" test was used to mako this 
determination. The rosults of this test showed bias to bo 
present In all thrco categories of instructional activity, in all 
casos tho questionnaire ostlmatos oxceeded tho diary tabu- 
lations, thus indicating an upward bias in tho estimation of 
tlmo expenditure on tho questionnaire, 

In order to respond to tho questions or hypothesos 
concerning the detection of dif/erencos in bias between 
ranks or disciplines, a two-way blocking dosign analysis of 
varianco (ANOVA) model was used. In this modol indi- 
vidual bias wcro considered to be the experimental units, 
academic disciplines wcro tho blocks, and academic ranks 
represented tho treatments. This procedure yiolded a four 
block by thrco treatment (or twolvc cell) segmentation of 
the population. 

Uso of this model revealed no differences In bias be- 
tween tho thrco academic ranks of profossor, associato pro- 
fessor, and assistant profossor for any of the thrco cate- 
gories of activity. That is to say, that although bias factors 
oxlsted for each rank, incro wcro no statistically significant 
differences in bias between ranks. 

When testing for differences between disciplines, 
however, thero were statistically significant differences 
found in the activity category called classroom instruction, 
Tho levels of bias wcro as shown In Figure 1, and the statis- 
tical tosts were as shown in figuro 2, 

Conclusions 

Tho findings of this research lead one inoxorably to 
certain conclusions. Tho first of theso is that where a ques- 
tionnaire instrument is used to obtain self-reported esti- 
mates of time and effort expenditure, there is a distinct 
possibility that bias will bo found in tho responses. 

Tho second conclusion is that whercvor accurate 
estimates of time/effort arc needed through self-reporting 
instruments, a diary should be used in lieu of a question- 
naire, Tho results of this study demonstrate tho virtues of 
tho diary where accuracy of data is a primo consideration. 
Diaries require respondents to write down their activities 
as they occur. No reliance need be placed upon memory or 
upon one's ability to estimate average time expenditure. 
Thus, a diary is an ex post documentation of events that 
have occurred, while a questionnaire typically requests es- 
timates of past, present, or future events. 

The third conclusion concerns tho existence of bias 
among groups of respondents. This study has shown that 
people differ in their tendency to bias questionnaire re- 
sponses. The differences between individual biases were 
expected, whereas the differences in group bias were not. 
The large difference between the bias reported by Arts and 
Letters discipline and the other three disciplines is ample 
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figure 1 
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evidence that groups of respondents can collectively, and 
without apparent collusion, bias questionnaire Inputs In 
the same direction and to the same degree, 

A fourth conclusion may be drawn concerning the 
Composition of bias. Bias, as used In this research, Is the 
algebraic difference between diary values and question- 
naire values. Given this mathematical definition, one must 
carefully question the factors that make up the bias. The 
existence of both accurate and inaccurate estimates of time 
expenditure on the questionnaire lead one to believe that 
there are two major components to bias. The first of these is 
the ability, or inability, of the individual to estimate time 
expenditure. The second component, independent of one's 
estimating ability, concerns the existence of a conscious 
effort to alter these estimates once they have been made. 

Implications 

This study should be of interest to administrators 
and managers who contemplate the use of self-completion 
instruments to obtain time/effort expenditure data from 

9 
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employees. Although it is clear that bias can exist in data 
obtained through questionnaires, it should bo equally clear 
that it can occur on diaries or any other self-reporting 
instrument. The nature of the diary technique is such, how* 
ever, that U takes a more deliberate and consistent effort on 
the part of a respondent to bias a series of diaries, Thus, al- 
though one cannot expect to find bias completely absent in 
diary-produced data, one can expect to find Its presence 
minimized, 

Administrators should also be aware of the trade-off 
between the need for accurate information and the cost of 
obtaining it. A carefully controlled diary census of all 
faculty would provide the most reliable estimate of faculty 
activity that Is possible using self-completion devices, 

This procedure is quite cosily to cany out, The costs 
associated with planning for such a project: printing 
costs for thousands of diary sheets, the expense of en- 
velopes for mailing, the cost of mailing {either in postage or 
increased work force for campus mail), the personnel 
needed for processing completed diaries and tracking down 
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figure 2 
TEST OF HVPOTHESIS 



1. Null Hypothesis) 

There Is no significant difference that can be 
assignable to differences In academic disciplines 
between the mean number of hours reported In 
selected categories of activity on the question* 
naire when compared to similar activities reported 
on the diary. 

2. Test Statistic: 

An ANOVA model and an Rest where dfi«4 and 
dfa«36 

3. Boundaries for the region of acceptance; 

a. For pa. 01 Fj/*-»4.38 

b. For pa, 05 Fj/36b2.86 

c. For p». 10 Fvwn2.25 

4. Results of calculation of the F statistic: 

a. Classroom Instruction: 6.6077* 

b. individual Instruction: 2.1561 

c. Advising: 1.3419 

♦ statistically significant 

5. Implications of the results: 

a. In the activity Classroom Instruction one can 
reject the null hypothesis at the P«.01, .05, 
and .10 levels. 

b. In all other activity categories one may not 
reject the null hypothesis based upon this 
evidence but must reserve judgment. 



missing diaries, and finally, the computer costs for tabu- 
lation and analysis; sum up to a large dollar amount. 

At some small sacrifice in accuracy but at consider- 
able saving in dollar expenditures, one might conduct a 
diary study involving a carefully selected sample of faculty, 
rather than a census of faculty. At even less cost and with 
lesser precision of results, one might consider using a ques* 



tionnaire census (or sample) of faculty, 

For most applications it is neither necessary nor de- 
sirable to incur the costs associated with obtaining precise 
estimates of employee time/effort expenditure, If one is 
witling to accept the bias likely to occur in questionnaire- 
gathered estimates of time/effort expenditure, then the pre- 
cision versus cost decision should be an easy one to make. 
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Quito simply, with decreasing requirements for accuracy, 
concomitant cost reductions can bo realized. 

In closing 1 would llko to sharo with you tho 
thoughts of a pioneer in tho field of institutional research, 
Hugh Stickler, Tho following comment from his 1959 
classic paper on faculty load studios provides an excellent 
summary for Ihis paper 

From tho various studies to which reference has 
been made in this paper , . . 'total workload cannot 



simply bo described or easily measured, Literature to 
date is confusing, fragmentary, and inadequate Find- 
ings aro frequently conflicting and/or inconclusive. 
Relatively llttlo real progress has been made in de- 
veloping adequate techniques for tho measurement of 
total faculty loads' . , , That was tho attitude when 
Rcevos and Russoll described It In 1929; It Is still tho 
situation thirty yoars later in 1959.' 
And what of 1974? 



'For more on this topic see: Patrick II. Sullivan. "An Analysis of Selected Techniques for Reporting or Time/Effort for Management and 
Control" (unpublished dissertation, Florida Slate University. 1972). 

•Theodore Caplos. ' Tho Dynamics of Faculty Load Studies/' In Faculty World Load, cd> by Kevin Bnell (Washington. D.C.; American 
Council on Kducallon. 1900). p, (>9. 

■F.W. Reeves and |.D. Russell. "Instructional Loads." College Organization and Administration (Indianapolis, Ind.: Board of Education, 
Disciples of Christ. 1929). pp. WWl, ' 

«Sevoral papers should be devoted lo this key point alone. Tho question of diary versus Questionnaire, el al, as it relates lo this research 
is addressed in Sullivan. "An analysis of Selected Techniques for Reporting of Timc/Bffort for Management and Conlrol. 

*W Hugh Stickler "Working Material and Bibliography on Fucully Load," in Faculty Work Load. cd. by Kevin Bunnell, p. 84 citing 
M.B. Haggcrty The Evaluation of fifghcr Institutions (Chicago, ill.: University of Chicago Press. 1937), pp. 144-56. 
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DETERMINING FACULTY ATTITUDES TOWARD COLLECTIVE BARGAINING USING PATH ANALYSIS 



Malcolm C. Mc/nnis, /r., University of Tennessee 
and P. Craig Johnson, Florida State University 



There has been a great deal of material published 
slnco 1968 concerning collective bargaining in higher 
education. However, the majority of this literature has been 
philosophical or legalistic In nature unsupported by 
empirical data. A review of the empirical research con- 
cerning collective bargaining In education rovoalcd loss 
than a dozen reported studios, nono of which sought to 
analy2o faculty attitudes toward collective bargaining in a 
four-year college or university. 

Despite the paucity of empirical research studies, tho 
few reported have already investigated the relationship 
between collective bargaining attitudes and a wldo variety 
of domographlc and career variables, Whllo most of thoso 
variables were significantly related to collective bargaining 
attitudes, tho uniform weakness of tho roportcd re- 
lationships was notoworthy, Ono implication suggested by 
theso findings is that collective bargaining attitudes are 
broader in scopo than mcro demographic variables would 
indicate Stronger relationships might thercforo be obtained 
by tho identification of a varlablo reflective of a broador at- 
tltudlnal framework. 

Levlno (1965), in a study of educational viewpoints 
of selected suburban residents, found that a significant 
relationship oxlstcd between liberal-conservatism on social 
and economic issuos, and vlows on education. In a similar 
study of the selected public school teachers by Callgurl and 
Levlno (1967), It was found that the relationship between 
liberal-conservatism and educational viewpoint was strong 
enough to withstand tho homogenizing offect of pro- 
fessional training. Ono implication of these findings Is that: 
, . , attitudes toward education aro so embedded in 
a broader attitudlnal framowork that knowlcdgo of 
an individual's general orientation toward govern- 
ment and society offers some predictive power 
concerning his reaction to specific educational 
policies. 

if one assumes collective bargaining, like education, 
is closely associated with governmental activity, then many 
of tho attitudes associated with collective bargaining in 
higher education may center upon questions with broad 
social and economic Implications. Therefore, faculty 
member's liberal-conservative orientation toward 
government and society should be related to his collective 



bargaining attitudes. 

Knowlcdgo of tho relationship botweon a faculty 
member's llbcral-consorvallvism and his attltudos toward 
collective bargaining should provldo some Insight into the 
gcnoral formation of thoso attitudes. There Is little, how- 
ever, that oithcr the faculty or administration could do in 
response to this knowlcdgo to altor faculty action, Thus, 
identification of a determinant ovor which tho affected 
parlies havo somo control, such as tho oxtcnt of shared 
authority scorns desirable, 

As early as 198?, tho Amorlcan Association for 
Hlghor Education (AAHE) was concerned with faculty dis- 
content and tho potential impact of collective bargaining on 
campus govoranco. As part of that concern they published 
Faculty Participation In Academ/c Governance (1987), a 
report of tho task forco on faculty representation and aca- 
demic negotiations, campus governance program, That re- 
port, In part, found that an cffcctlvo system of campus 
governance should bo built on tho concept of authority 
shared by the faculty and administration. Further, It found 
that shared authority can bost bo implemented through tho 
establishment of Internal organizations and that formal bar- 
gaining relationships arc most likely to develop when such 
organizations aro not provided and supported. 

In 1971 tho AAHB published Shared Authority on 
Campus, another report of the campus governance pro* 
gram. This report, in essence, proposed a reconsideration of 
authority relationships with a view to a moro effcctlvo hear- 
ing for students, faculty, and other inadequately heeded 
campus constituencies. 

Other authors have also suggested tho Importance of 
an increase in shared authority, William Boyd, President of 
Central Michigan University, suggests that unionization 
results from a *\ , . search for new means of asserting pro- 
fessional power in areas where faculty (end to be losing to 
outstdo forces." Similarly, Sheila Polishok (1970), of the 
City University of New York, noted that; 

As they probably are ctscwhero, the realities of power 
were /it the center of the movement toward collective 
bargaining at tho City University. Not unlike Ameri- 
can ikillcd workers in the early nineteenth century, 
moit faculty members were convinced that their pro- 
fessional oxlstenco could no longer bo protected by 
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individual initiative, 

If faculty discontent is related, at least in part, to u 
lack of meaningful faculty participation in campus govern- 
ance then a measure of the perception of faculty participa- 
tion in governance should rolato to collective bargaining at- 
titudes, 

Provious research reporting significant, although 
weak, relationships between collective bargaining attitude 
and demographic characteristic made it desirable to con- 
tinue this area of investigation. Because of the low correla- 
tions previously reported, only the basic demographic char- 
acteristics of ago, sex, rank and tenure status were in- 
cluded, The economic emphasis of ^collective bargaining 
suggested the need to measure faculty members' perception 
of the adequacy of the academic salary scale at their institu- 
tion, Recent activities of the major professional organi- 
zations — AFT, NSP, AAUP — in tho area of collective bar- 
gaining suggostcd the desirability of collective information 
concerning faculty membership in these organizations, 

Procedure 

A research questionnaire was designed to collect in- 
formation about basic faculty characteristics — ago, rank, 
sex, tenure status, salary perception, organization member- 
ship — together with previously developed scales to mea- 
sure faculty attitudes toward collective bargaining (Moore, 
1970), their llberal-conservativism (Levinc, 1965), and per* 
ception of shared authority (Morgan, 1971). 

Tho collective bargaining scale was adapted from a 
scale utilized by Moore (1970) In his study of Pennsylvania 
Community College faculty, Moore's scale consisted of 
thirty opinion statements concerning collective bargaining, 
sanctions and strikes in higher education. The only modifi- 
cation of his scale was the substitution of collective bar- 
gaining for ''collective negotiation" throughout the scale. 

Tho liberal-conservatism scale was originally de- 
veloped by Levine in a study of its correspondence to edu- 
cational viewpoints (1965). The scale consisted of two 
parts, each with ten items, to measure liberal conservatism 
on social and economic issues. This scale was used without 
modification. 

The scale used for the measurement of faculty per- 
ception of shared authority was adapted from one de- 
veloped by Morgan (1971). In his exploratory study of the 
"Measurement of Decentralization in University Organiza- 
tions,'* the author had faculty members rate the order of Im- 
portance of twenty-six select decisions. Subsequently, 
these decisions were rated by faculty using a 5-item Likert* 
type format graduated to show increased sub-unit control. 
The only modification of the Morgan scale was the deletion 
of eleven of the original twenty-six decisions to more ap- 
propriately reflect decisions associated with the sub-unit 
selected for this study. 



Analysis of the Data 

Tho research questionnaire was distributed to all 
fuU-tlmo faculty members at Tho Florida Stale UnlvorsUy, 
A total of 433 answer sheets, 39,30 percent, wore usable, An 
analysis of tho distribution of tho sample, according to 
basic demographic characteristics, indicated an oxtromoly 
close fit to tho population with no significant deviations. 

Liberal-Conservatism 

in order to determine tho linear relationship between 
scores on tho liberal-conservatism and collective bargaining 
scales, a Pearson product-moment correlation coefficient 
was computed. Tho correlation coefficient was equal to 
-.56, which was statistically significant at the ,05 level (p< 
.001). Tho Power of this tost for a medium effect size (r* 
,30) was greater than ,995. Thus tho Inference can bo made 
that a linear relationship exists between faculty liberalism 
and positive collective bargaining attitudes. 

Refinement of a linear relationship of these two vari- 
ables was accomplished by dividing the sample into sub* 
groups according to tho selected faculty characteristics. 
Each subgroup — rank, ago, sex, tenure status, salary per- 
ception, organizational membership was further sub- 
divided into classes, 

Pearson product-moment correlation coefficients 
were computed, for each class within tho subgroups. Tho 
correlation coefficient of each class together with a test of 
significance is presented in Table 1. The results (Table 1) 
indicate that the correlation coefficients for all classes ex- 
cept two were significant at the ,001 level. Tho class for 
faculty over 60 years of age was significant at tho .05 level 
and the class for APT membership was not significant at 
the level selected (.05), Correlation coefficients substan- 
tially greater than for the entire sample (r« -,56) were noted 
for assistant professors (r»-.62), instructors (r«-.72), 
faculty ago 30-39 yiars (r»-.61), females (ra-.63) and 
nontenured faculty (r*-.62). Substantially lowor 
correlation coefficients wore associated with AFT 
membership (r« -.11), AAUP membership (r« -.40), tenured 
faculty (r« -.47). professors (r« -.41) and faculty over age 60 
(r«-,36). 

Tho comparison of correlation coefficients between 
classes within each subgroup indicated five significant dif- 
ferences (.05 level). The correlation between llberal-cort- 
servattsm and collective bargaining was significantly lower 
for AFT members (r=-.1l) and AAUP members (r«-.40) 
than faculty Indicating no organizational membership, (i.e., 
AFT, NSP, AAUP), (r-..59), Non-tenured faculty (r--,62) 
Indicated a significantly higher correlation than did the 
tenured faculty (rs-.47). Two additional significant differ- 
ences were indicated in comparisons associated with 
faculty rank, Professors (r=-.4l) had a significantly lower 
correlation than did either instructors (r».,72) or assistant 
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Table 1 

PEARSON PRODUCT-MOMENT CORRELATION COEFFICIENTS FOR FACULTY 
SCORES ON LIBERAL-CONSERVATISM AND COLLECTIVE BARGAINING 
SCALE BY SAMPLE SUBGROUP 



Subgroup Class N r 



KApK 


rroiessor 


136 


-.4"' 




Associate Professor 


102 


-.55* « 




Assistant Professor 


157 


-.62* * 




Infcfri Iff 


27 


•.7* 


Age 


unoer ju 


61 


••57* ' 




31-39 Years 


133 


-.61 « 




4049 Years 


107 


-.52^ 




50-59 Years 


95 


-.55* * 




Over 60 Years 


37 


-.36* 


Sex 


Male 


356 


-.54* < 




Female 


76 


-.63* * 


Salary 


Below Average 


217 


-.58* 1 


Perception 


Average 


153 


-.61 •« 




Above Average 


49 


-.55* < 


Tenure 


Not Tenured 


234 


-.62* < 


Status 


Tenured 


191 


-.47* < 


Membership 


AFT 


32 






AAUP 


135 


-.40* ' 




None 


258 


-.59* 



• Significant at the .05 level. 

• M Significant at the .001 level. 

professors (r= -.62). 

Shared Authority 

In order to determine Ihe linear relationship between 
scores on the shared authority and collective bargaining 
scales, a Pearson product-moment correlation coefficient 
was computed. The correlation coefficient was equal to 
-.41. which was statistically significant at the .05 level 
(p < .01). The power of this test for a medium effect size 
(r»-.30) was greater than ,995. Thus the inference can be 



made that some relationship exists between low faculty 
perception of shared authority and favorable collective bar- 
gaining attitudes. 

Refinement of the linear relationship of these two 
variables was accomplished by dividing the sample into 
subgroups according to the selected faculty characteristics. 
Each subgroup — rank, age, sex, tenure status, salary per- 
ception, membership — was farther divided into classes. 

Pearson product-moment correlation coefficients 
were computed, for each class within the subgroups. The 
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Table 2 

PEARSON PRODUCT-MOMENT CORRELATION COEFFICIENTS FOR FACULTY 
SCORES ON SHARED AUTHORITY AND COLLECTIVE BARGAINING 
SCALE BY SAMPLE SUBGROUPS 



Subgroup 


Class 


N 


r 


Rank 


Professor 


136 


-.31*" 




Associate Professor 


102 


-.09 




Accident Pr/\ face n r 


ID/ 


. AC 




Instructor 


27 


-.05 


Age 


Under 30 


61 


-.05 




31-39 Years 


133 


-.28* ♦ 




40*49 Years 


107 


-.27" 




50*59 Years 


95 


-.04 




Over 60 Years 


37 


-.04 


Sex 


Male 


356 


..21" 




Female 


76 


-.06 


Salary 


Below Average 


217 


-.13 


Perception 


Average 


153 


-.12 




Above Average 


49 


-.20 


Tenure 


Not Tenured 


234 


-.02 


Status 


Tenured 


191 


-.30»" 


Membership 


AFT 


32 


+ .05 




AAUP 


135 


-.14 




None 


25f 


-.06 



♦♦Significant at the .01 level. 
♦♦♦ Significant at the .001 level. 



correlation coefficients of each class together with a test of 
significance is presented In Table 2. The results {Table 2) 
indicate a significant correlation between shared authority 
and collective bargaining only for professors (r--.31), age 
ranges 30-39 (r--.28) and 40-49 {P--.27), males (r— -.21) 
and tenured faculty (r«-.30). Correlations substantially 

ERLC 



below that for the entire sample (r=» -.14) were noted for all 
ranks except professor* females (re..08)» nontonurcd 
faculty (r»- k 02), AFT members ( + .05), and the non« 
membership class (r» -.08). 

The comparison of correlation coefficients between 
classes within a subgroup indicated only two significant 
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Table 3 

PEARSON PRODUCT-MOMENT COORELATION COEFFICIENTS AND COEFFICIENTS 
OF DETERMINANTS FOR FACULTY SCORES ON THE COLLECTIVE 
BARGAINING SCALE BY SUBGROUPS 



. . Coefficient of 

Faculty Correlation Determination 

Characteristic Coefficient r> 

Rank .,13" .02 

Age .20" .04 

$** ,14" .02 

Salary Perception ,17* # ,03 

Tenure Status ,16" .02 
Organization 

Membership ,35" ^2 



N m 433 

" Correlation coefficient significant at the .01 level. 



differences (.05 level). The correlation between shared 
authority and collective bargaining was significantly higher 
for professors (r«-.31) than assistant professors (rw.05). 
Similarly tenured faculty (r«-.30) had higher correlation 
coefficients than did nontenurcd faculty (r«-.02) 

Faculty Characteristics 

Pearson product-moment correlation coefficients 
were computed between the selected faculty characteristics 
— age, rank, sex, tenure status, salary perception, organiza- 
tional membership — and collective bargaining attitudes. 
The results including the correlation coefficeint, coefficient 
of determination and test of significance are summarized in 
Table 3. Because directionality was not hypothesized, a 
two-tailed test of significance at the .05 level was selected. 

Path Analysis 

The results of this study, as have the previous 
studies, indicated a significant but weak linear relationship 
between demographic characteristics and collective bar- 
gaining attitudes. Therefore, further analysis to examine the 
mcaningfulncss of these relationships was indicated. 

First a hypothesized causal model was developed 
specifying the interrelationship between the Independent 
variables ~ rank, age, sex, salary perception (SP), tenure 
status (TS), liberal-conservatism (LC), shared authority 



(SA), organizational membership (OM) — and collective 
bargaining attitudes. Second, the causal model was tested 
using the techniques of path analysis. 

The results of that analysis according to the hypothe- 
sized causal ordering arc summarized in Figure 1, The 
direct effects between determining and the dependent vari- 
ables arc shown by stralgh line arrows, The value ac- 
companying those arrows is the path coefficient (J.e M stan- 
dardized regression coefficient), The curved arrow between 
age and sex indicates an unanalyzcd correlation. The 
arrows coming from outer space denote the residual (i.e., 
the variance unexplained by the multiple regression equa- 
tion). 

According to the hypothesized causal model, certain 
relationships arc assumed. First, sex and age influenced 
rank. Both variables were found to have significant path co/, 
efficients with age being the stronger of the two. * 

Second; rank, age, and sex influenced tenure status 
(TS), Only rank and age had significant path coefficients 
with (TS). Substantially, this finding says that sex docs not 
have a direct bearing upon (TS) but docs have an indirect 
effect through its influence on rank. With sex removed 
from the regression equation new path coefficients were 
computed indicating rank somewhat stronger than age. 

Third; rank, age, sex and tenure status (TS) in- 
fluence salary perception (SP) of these variables only sex 
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rifurt 1 

PATH ANALYSIS SUMMARY 



4141 



.9476 



.9450 



UIERAUSM 
CONSERVATISM 
(IC) 



SHARED 
AUTHORITY 
(SA) 




.301 



ORCAN. 
MEMBERSHIP 

(OM) 



.177 



.113 



.m 



.097 



.7675 



.7911 



.9663 



.9810 



was found to have an Insignificant path coefficient. This 
means that sex does not have a direct effect on (SP) other 
than Its transmitted through rank directly to (SP) or indi- 
rectly through (TS). The new path coefficients computed 
with sex deleted indicated that rank had a stronger influ- 
ence than either age or (TS). 

Fourth: age, rank, sex, tenure status (TS). and salary 
perception (SP) influence liberal-conservatism (LC). Only 
age and sex were found to have a significant path coeffi- 
cient with (LC). This means that rank. (TS), and (SP) do 
not have a direct effect on (LC). The new path coefficients 
with rank, (TS). (SP) deleted indicated that age has a 
greater influence. 

Fifth; rank, age, sex, tenure status (TS), and salary 
perception (SP) influenced shared authority (SA). The 
regression analysis indicated that age. rank, and (SP) 
directly influenced (SA). This means that the influence of 
sex is Indirect and only to the extent it affects rank which 
affects (SP). 

Sixth; rank, age, sex. tenure status (TS), salary per- 
ception (SP), liberal-conservatism (LC), and shared 



authority (SA) influenced organizational membership. The 
regression analysis showed that of these variables only 
(LC) and (SA) were directly related. The remaining vari- 
ables had indirect effects through these two variables. The 
various paths were discussed under the section dealing 
with (LC) and (SA) as dependent variables. 

Lastly, all of the independent variables, rank, age, 
sex, tenure status (TS), salary perception (SP), liberal-con- 
servatism (LC), shared authority (SA), and organizational 
membership (OM) influenced collective bargaining atti- 
tudes. The regression analysis showed that age, (LC), (SA), 
(SP). and (OM) had significant path coefficients with col- 
lective bargaining. This means that sex, rank and (TS) in- 
fluence collective bargaining attitudes only to the extent of 
their indirect influence on (LC), (SA), and (OM). When the 
path coefficients were recomputed with rank, sex and (TS) 
deleted, the significant variables, in order of (he strength of 
their effects were (LC), (SP), (OM), (SA) and age. 

The results of path analysis indicated that sex, rank, 
and tenure status do not have a direct effect on collective 
bargaining attitudes. According to path theorem, if a truly 



9 

ERIC 



167 



DETERMINING FACULTY 



professors-assistant professors, tonurcd-not tonurcd, 
AAUP-nono, and AFT-nono, 

Tho analysis concerning Iho shared authority scale 
revealed a significant correlation botweon a low perception 
of department autonomy and favorable collective bargain* 
Ing attitudes, Tho strength of this correlation was Increased 
for faculty who wore a full professor, male* or tonurcd, 
When correlations wore compared botweon groups, a 
significant difference was noted botweon professor* 
assistant professor and lenurcd-non tenured groups. 

Tho results of tho path analysis Indicated that sex, 
rank, and tenure status do not have a significant direct 
effect on collective bargaining attitudes, Tho effect of ago 
on collective bargantng attitudes was found to bo primarily 
Indirect, although a small direct effect was noted, 

Conclusion 

Tho findings suggest that factors contributing to 
faculty attitudes toward collective bargaining may bo more 
complex than has been generally acknowledged. Tho 
reliance upon basic faculty demographic characteristics 
may bo limited to describing the proponents of collective 



, TABLE 4 

CORRELATION MATRIX INDEPENDENT VARIABLES WITH 
COLLECTIVE BARGAINING FOR ORIGINAL ZERO 
ORDER CORRELATION COEFFICIENTS (UPPER 
PART) AND RECALCULATED CORRELATION 
COEFFICIENTS (LOWER PART) 



ln<J<p*n<J<n1 
Virlibtct 


Set 


Ag€ 


Rank 


Tenure 


SaUry 


Shared 
Authority 


Liberal 
Conservatism 


Organtfationat 
Membership 


Collective gar- 
gaining Alffl. 


$♦* 




.1542 


.129) 


.0529 


•.1468 


.044) 


•.1779 


.080) 


.1409 


Age 


.1542 




-.1)64 


.5257 


-.1701 


.1212 


•.2887 


.0090 


.1)5) 


JUn'* 


.\m 


.5)54 




-.5464 


'.0)97 


.0)58 


.1290 


,0255 


1288 




,002) 


.52 S 5 


•5464 




-.1311 


.0414 


-.21M 


.0405 


.1577 


$4t*ry 




-.2040 


.0)64 


.IMt 




•.1291 


.0711 


.0688 


.1728 


Shared 
Authority 


04% 


.1210 


,0284 


.aw 


•1291 




• 0286 


-.147) 


-.1)91 


liberal 
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nonsignificant path is 'talctcd, Iho recalculated correlation 
will equal Iho original tcro-order correlation. To test the 
dclotod palhs, rank, sex, and tenure status, tho correlation 
coefficients for tho ontlro matrix woro recalculated. Tablo 4 
presents tho correlation matrix with tho original coefficient 
on top and the recalculated coefficients on tho bottom. Ac- 
ceptable differences (loss than .05) between tho original 
and recalculated correlation coefficients woro Indicated for 
sox, rank, and tenure status, A comparison of tho difference 
between original and recalculated correlation coefficients 
for tho entire matrix suggests a reasonably close fit for tho 
hypothesized model. 

Summary 

Analysis of tho liberal-conservatism scale revealed a 
significant positive correlation botw^n faculty liberalism 
and favorable collective bargaining \u ulcs. The strength 
of this correlation was weakest ten fauuiy who were over 
60 years of ago, tenured, of the rank of profos. < ' a 
member of APT or AAUP. When ^relations i«rc 
compared between groups, significant difference ro 
noted for tho following groups: profcssors«instrui irs, 
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bargaining rather than explaining their preference. Ago, 
8ox, rank, and tenure status appear to affect collective bar- 
gaining attitudes primarily in an indirect way and thus 
havo limited uso as predictors. 

Tho findings concerning the liberal-conservatism 
scalo suggost that faculty attitudes toward collective bar- 
gaining are broadly based and generally similar to an 
Individual's view of government and society, Refined 
analysis of this variable suggosts that specific situational 
variables tend to override this general relationship. 

Tho relative weakness of tho relationship of tho 
shared authority scalo to collective bargaining attitudes 



suggests that omphnsls on this determinant may bo 
misplaced, it should bo noted, however, that this variable Is 
related to departmental autonomy, Tho findings suggest 
that tho strength of this relationship may bo depressed 
because of differences of Individual autonomy within de- 
partments, 

Tho results concerning salary perception generally 
support tho emphasis of collective bargaining on economic 
Issues. However, tho weakness of this relationship suggests 
that reliance on this determinant as being primary may not 
be justified, 
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AN ANALYSIS OF THE EFFECTS OF TUITION AND FINANCIAL AID POLICIES 

Robert Winter, University of Illinois 



This paper describes an analysis of tho offecl(s) and 
feasibility of changes of tuition and financial aid policies 
which may be Implemented to guarantee opportunity for a 
college education to all qualified college-age youth. The 
effccl(s) of such policy changes are described in terms of 
expected changes In college enrollments, classified by 
income distributions of college enrollments, which result 
from changes In tho "unmet costs" borne by students from 
different family income groups. Such "unmet costs" arc de- 
fined as tho sum of the expected parental and student 
contributions towards college expenses and financial aids 
(excluding loans and employment). 

Introduction 

In its regular meeting ot December 1970» the State of 
Illinois Board of Higher Education approved an Increase of 
tuition charges for public senior institutions. This Increase 
was the first of a scries of significant tuition increases to be 
experienced in tho early seventies. 

These drastic increases in tuitions have generated 
numerous discussions on the role of public education and 
the effect of high costs on the ability of all qualified youth 
to obtain a college education. "Equal opportunity" has be- 
come tho central issue in all discussions of tuition levels 
and financial aid programs. Tho concept of "equal oppor- 
tunity" has been described by Hansen and Wclsbrod in the 
following manner* 

First and foremost, ono of society's major goals is 
that of promoting greater equality of opportunity, a 
goal that can be achieved by making post-secondary 
education and training more generally available. This 
means that all students wishing to should be able to 
attend a post-secondary school for which they arc 
qualified, and to do so without undue financial 
concern. 1 

"Equal opportunity" has been an Integral part of 
American democracy, which has led to the large growth of 
publicly-supported institutions of higher education in the 
United States, especially since 1945. It Is this concept which 
has resulted in low tuition levels, although evidence does 
not shown that ' equal opportunity" has been achieved. 

The Tuition Controversy 

The trend towards higher tuition levels at public in- 



stitutions has renewed the debate as to whether tow tuition 
levels should be maintained or whether, in fact, higher tui- 
tion levels may facilitate the achievement of "equal oppor- 
tunity" by allocating a part of the additional Incomo to 
financial aid programs which would remove financial 
barriers from college education. 

Thrco significant lines of thought have been de- 
veloped to support high tuition levels: 

A. The subsidy argument — Proponents of higher tuition 
levels are well represented by the following statement 

made by Bolton: 

Some argue strongly that the present system 
excessively subsidizes higher income families, 
because the tow tuition in public institutions 
is available to students without consideration 
of whether they could pay their own way. 2 
It follows then, that by increasing tuition, funds would 
be made available to allocate to financial aid programs 
which would make "equal opportunity" objectives 
possible. The net effect would be that of shifting costs 
to higher and higher-middle class families while 
lowering the costs of a college education to low and 
lower-middle class families. 

B. Tho viability of private education argument — ' Low tui- 
tions have created a concern over their effects on the 
viability of private institutions. This concern was 
expressed in the "Higher Education in the United 
States: The Economic Problem" Seminar held iu 1958: 

The private colleges fear that tax-supported, 
low tuition state universities may eventually 
run them into bankruptcy.* 
Higher tuitions at public Institutions would insure the 
viability of private institutions since the later would 
become price-competitive. 

C. The benefits argument — Another view In the tuition 
dobate has been presented by those who have 
discussed college education in terms of societal and 
personal beneifts. Owen exemplifies this argument in 
the following statement: 

Many economists, and others, believe that the 
subsidy of college students is justified on the 
grounds that, without subsidy, the private 
value of a youth's college would typically be 
less than its social value — thus leading to a 
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loss than socially optima) lovol of expen- 
ditures on collcgo educations 
Owen also asserts that both privato and social benefits and 
costs will be different for different groups; for example, for 
non-whlloa the private value may bo towor and tho social 
benefit may bo higher, This argument supports policies 
which incrcaso subsidies to low and lowor-middio class 
youth. 

Proponents of low tuition levels argue that high tui- 
tion levels would destroy tho illusion that education can bo 
had cheaply, therefore, discouraging low and lower-middle 
class youth from obtaining a college education, 

In tho final analysis, a decision of low versus high 
tuition is based on tho political factors affecting tho stato 
and, moro importantly, tho resources available to tho state, 
The most Important factor will bo tho willingness of society 
to support programs which will assume tho achievement of 
"equal opportunity" objectives. 

Analysis of Tuition — Financial Aid Models 

The Issues discussed in the previous section raise 
several concerns as to the mechanics required to achieve 
"equal opportunity/'Whcther tuitions should remain low or 
should bo Increased, or whether societal and persona) 
benefits should bo accounted for by the pricing structure of 
college institutions are not treated hero as tho principal 
issues. Tho achievement of 'equal opportunity" is treated as 
an economic Issue, with attention to: plans that rccognizo 
limited public resources, tho likelihood that tuition levels 
will bo increased and larger subsidies may be given to stu- 
dents from low and lowor middle incomo families, and (hit 
these steps will bo taken not on tho basis of tho social cri- 
terion of who deserves assistance, but by tho economic cri- 
terion of who needs it most. 

The effect of tuition and financial aid policies is 
evaluated in terms of the impact of college-age youth and 
their families. The decision to attend college may bo af- 
fected by tho following factors, as described by Hansen and 
Weisbrod: 

Tho cost of a college education to a student and his 
family — apart from tho incomo foregone ~ can be 
analyzed in two parts, Ono can bo termed the "price" 
of education — tho tuition chargo, the books and sup* 
plies, and so forth. The second Is the "case of finan- 
cing 41 that price — that is. tho availability and terms 
of loan funds and scholarships. 5 

The financial aid avaitablo to needy students may bo 
of three forms: gift aid, part-time employment, and loans. 
Gift aid may bo defined as a nonrepayable subsidy 
awarded directly to the student* while a loan will requiro 
repayment of the original amount plus added interest. Tho 
analysis presented in this paper assumos that only gift aid 
will be considered as an effective tool to help achieve 
"equal opportunity/ 1 while loans may be used by students 
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and/or parents to flnanco tho oxpected contributions to tho 
cost of education and tho unmet cost — the pottlon of 
collcgo coBls not covered by gift aid. 

During 1064, tho Illinois Board of Higher Education 
conducted a study to analyzo tho composition of the 
student body In institutions of hlghor education in tho Stato 
of Illinois, This study concluded that; 

Based on high school rank in graduating classos* 
25% of thoso students in tho uppor quarter and 44% 
of thoso In tho second quarter do not go on to col* 
lege, 0 

Tho results of this study gavo impetus to tho rapid 
growth of tho Illinois Stato Scholarship Commission 
(ISSG). This growth is consistent with tho direction recom- 
mended by tho Board of Higher Education In Its attempt tc 
achieve ' equal opportunity 14 in the Stato of Illinois. Tho ob- 
jectives of tho Illinois Stato Scholarship Commission aro 
expressed in its 1070 Anneal Report: 

... to remove financial barriers to college attend- 
ance; to oxpand collcgo choice; and to permit thou- 
sands of students to attend non-public colleges who 
would havo otherwise attended public colleges and 
added to tho stato subsidy of operating and capital ox* 
penditures. 7 

The Illinois State Scholarship Commission (ISSC) 
offers (wo major financial aid programs: 

1. Non-repayable grants awarded to "needy" undergrad- 
uate students, and 

2. Guaranteed loans granted to students through commer- 
cial lenders. 

The scholarship and grant programs aro limited to full-time 
undergraduate students who aro residents of tho State of 
Illinois and aro enrolled in-state In an institution of higher 
education. Tho Higher Education Student Assistance Law 
permits the ISSC to grant awards up to cither $1,200 per 
year or tuition and fees, whichever is loss. 

An analysis of the distribution of ISSC awards raises 
questions over tho limitations of tho Higher Education Stu- 
dent Assistance Law, Figure 1 shows tho 1972-73 distri- 
bution of unmet costs for ISSC recipients attending public 
and private senior institutions. This distribution brings to 
question whether tho ISSC objectives, stated previously, 
havo been achieved. 

In order to analyze the effect of improvements of tho 
ISSC programs, a computer simulation program was de- 
veloped to evaluate changes In tho following policies: 

t, Tho tuition, level for tho public senior institution was 
increased up to three times the 1970-71 levels. 

2. The extent of coverage of ISSC awards was varied 
between tho current tuition and fees limitations up lo a 
coverage of 100% need boyond tuition and fees, and 

3. The maximum size of ISSC awards was varied between 
the current $1,200 and $3,000, 

Tho computer simulation program subdivides the 
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figure 1 
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college population into twelve parental Income categories, 
and estimates for each category the amounts of financial 
aid and unmet cost for a given set of tuition and financial 
aid policies. An "equity index" was also calculated and 
was defined as the standard deviation of unmet costs. This 
index provides a measure of the achievement of "equal 
opportunity/* 

The development of the model was divided into 
three parts: 

A. Description of the CoJJege Population of the State of 
Illinois 

O 
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The college population was described in terms of 
income distribution, choice of institution, and expected 
parental contributions toward college expenses. This 
information was not available at the time, resulting in 
the following approaches: 

1. Income distribution — The most reliable informa- 
tion was found from the freshmen surveys 
performed by the American Council of Education 
(ACE). 

2. Expected porcntol contribution — Ihe expected 
parental contribution towards college expenses 
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was based on tho Coltogo Scholarship Service S97I 
ostlmatos. Tho following assumptions wero made 
relative lo tho number of dependents by family 
income: 

a, Families whoso incomes are less than $10,000 
average three dependents, and 

b. Families wilh Incomes above $10,000 average 
two dependents. 

U, Writing of tho Computer Simulation Program 

The program used as Inputs data which described; 
public senior, public junior, private senior, and private 
junior Institutions (i.e., tuitions, college budgets, and 
fulMimu enrollments) and the college population at 
each typo of institution (i.e., the information provided 
by ACE and average gift old other than ISSC). The out* 
puts of tho computer simulation program are summar- 
ized in Table 1. 
C. /ncorporot/on of Price Elasticities of the Demand for 
Higher Education 

Price elasticities of the demand for higher education 
have been estimated In works by Miller, 8 Campbell 
and Siegcl," Fcldman and Hoenack,' 0 Hopkins," 
Hoenack, ,a and Zorazzini. ,J Miller, for example, 
arrived at tho conclusion thai low income groups had a 
relatively elastic demand for higher education with 
respect to price, while high income groups had an in- 
elastic higher education demand with respect to price. 
Although not necessarily representative of the behavior 
of college youth and their families in the Slate of 
Illinois, the results obtained by Corazzini. et al, were 
utilized in this analysis. 

Corazzini, el al. estimated price elasticities by 
runing separate regressions on samples stratified by 
the Project TALENT by SKS variable. They arrived at 
the following estimates: 

a. Ep= .,32 for the; low SES and 

b. Kp b -.18 for the high SKS. 

The incorporation of price elasticities of demand 
for higher education Into the rnooeis previously 
described in this paper permits the evaluation of the 
effect of changes of tuition and financial aid policies 
on the total enrollment of the state and on the; 
enrollments by Institution type. Changes in 
enrollments by Income group and by institution type 
will be based on changes of the "price" of education. 

The "price" of education for an individual was de- 
fined as tho sum of the expected parental and student 
contributions towards college expenses, and Ihe unmet 
cost. Since, as was shown previously, unmet costs will 
vary for different income groups as tuitions for public 
senloi institutions and financial aid policies are varied, 
two effects on enrollment can be expected: 

1» An increase in the price of education — This in- 
crease will result from an increase In tuition 
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which must bo absorbed by tho student and his 
family. This condition may bo mere typical for 
upper middle and high income families, Tfifl 
expected effects on cr.rollment are explained by 
Hopkins' definition j: 

a. "Subsfifur/on' o//ccf — Somo students (69% 
of attrition), from public senior institutions 
could shift to private Institutions, and 

b. "Not discouragement" o//ocl — - Some 
students (31% of itlrlllon), from public senior 
institutions would drop out of college 
altogether. 

2. A decrease In tho price of education — An 
increase of financial aid, in tho form of monetary 
grants an<i tuition and fee waivers, to low and mldJlo 
income college youth will decrease thoit 1 price of 
education. This will result In an increase In their 
enrollments in Institutions of higher education. 

Table 2 describes Iho effect on students attending 
public senior institutions In the State of Illinois of 
increases in tuition levels coupled wit^ Improvements 
In financial aid programs offered by tho ISSC. Tho 
following set of policies is investigated: 

1. Tuition level at public senior institutions: two and 
half tlrr.es 1970-71 levels. 

2. Maximum awa 1 d — $3,000. 

3. Percent coverage beyond tuition and fees — 100% . 

Two distinct "jffecU can be identified: 

1. Unmet costs are decreased fow low and middle 
income families. The new map of unmet costs 
results from « significant Improvement of the 
Illinois Stale Scholarship Commission financial 
aid polh ics. 

2. The expected income distribution of enrollments 
in public senior institutions changes in two 
significant ways: 

a, Enrollment of youth from low and middle 
income families Increases (4,554 new students 
from families earning below $10,000), as a 
result of improved financial aid policies 
which lower tho price of education, The 
percentage of enrollments from families 
earning below $6,000 increases from Ihe 
current 7.2% to 6.ti% of the total enrollment in 
public senior Institutions. 

b. Enrollment of youlh from upper middle and 
upper Income families decreases (3.316 
students from families earning above $10,000), 
as a result of increases in tuitions which raise 
Ihe price of education. The percentage of 
enrollments from families earning above 
$25,000 decreases from Ihe current 9.0% to 
U.b% of the total enrollment in public senior 
institutions. 

173 



TUITION AND FINANCIAL AID 



Tabl* 1 

SUMMARY Of OUTPUTS OF THE COMPUTER SIMULATION PROGRAM 
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I • Equity Index; the standard deviation of unmet com. 
M • Maximum award value. 

C • Extent of coverage • the percentage of financial need mlnui tuition and 
feet by which awardi may exceed tuition and feel. 

TR * Tuition revenue* from public tenlor Inilltutloni. 

N • Net profit or lost to the Stale; the difference between tuition revenuei 
from public senior Institution! and I5SC expenditure!. 
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Tho results of this analysis point towards financial 
aid programs almod at achiovlng two ossontial 
ob)ectivos: 

1. Equalizing tho burdon for studonts currontly 
attending Institutions of highor education, and 

2, Reducing or eliminating financial barriors to 
academically ablo collcgo-ago youth, who, other- 
wise would not consldor enrolling fn coltcgo. 

Howovor, thoso results neither support nor reject low or 
high levels of luillon, Tho objectives stated above could be 
achioved just as well by maintaining low tuition lovcls and 
Increasing tho stato Invostmonl In the programs of tho ISSC, 

A Chatlenge to Current Policy Trends 

In the past few years, large Impetus has been givon 
to those attempting to resolve the financial problems faced 
by Institutions of higher education and collego-age youth, to 
implement policies which combine increaso of tuition 
levels and the expansion of financial programs, Certainly, 
such policies appear to be feasible, as is shown in the pre- 
vious section, but, in the opinion of the author, thoy are 
subject to challenge. 

Tuitions at public Institutions have been treated er- 
roneously as the price tc purchaso an education, although 
tuitions have been related to the cost of education on an ar- 
bitrary basis only. Tuitions at public Institutions aro, in 
fact, a form of user taxes and public institutions of higher 
education act as agents for tho state as tax collectors. If tui- 
tions aro treated as taxes, then it follows that their levels 
should not be established on an arbitrary or philosophical 
basis, but should be tied to the stato's tax strviiure which 
relates financial requirements to tho commitments or needs 
of public service, 

In the samo vein, financial aid programs must be 
treated as a service provided by the state. The decisions on 
the level of support of this service should be based on poli- 
tical interest groups. All play a rote in making decisions 
about the shapo and position of unmet-cost maps. The flow 
of funds, such as tuitions or user taxes, from students 
through public institutions of the state government, the 



support to institutions of higher education from tho stato to 
tho institutions and Indirectly to students, and tho support 
of financial aid programs from the stato through an appro- 
priate agency to students is doscribod in Figure 2, 

Tho proposed definition of tuition as taxos reduces 
tho valuo of the subsidy and the viabJlit/ of private educa- 
tion arguments sinco the state government has the option to 
legislate the lovol of subsidy given to oach citizen for each 
typo of public service Tho level of support to financial aid 
programs may bo determined by using the benefits argu- 
ment, or tho basic premiso that all qualified citizens aro en* 
titled to a collego education with tho absonco of financial 
barriers. This approach would allow tho achievement of 
"equal opportunity" objectives independent of tuition 
policies. 

Conclusion 

During the last few years, rising costs of education 
and limited government resources havo resulted in pres- 
sures to increase tuitions at public Insltutlons, Impetus to 
increase tuitions at public institutions has come from thoso 
who believo that low tuitions are not sufficient to insure an 
"equal opportunity" to obtain a college education; two 
problems aro identified: 

1. Students from high and higher-middle class familios 

receive a largo subsidy which they do not need, and 
2> Privato institutions risk financial bankruptcy sinco thoy 
aro unabto to compete on a tuition basis. 
Proponents of higher tuitions recommend that in- 
creases In tuitions should be coupled with increases in 
financial aid programs. Tho expected result would be to 
generate additional funds for the operation of institutions 
of higher education and funds required to obtain "equal 
opportunity" objectives through expended financial aid 
programs. Jl 

Although thowBoposals are feasible from an Imple- 
mentation view, they me not realistic from an economic 
and political view. Policies on tuition levels and financial 
aid programs should be independent of each other and 
should not be combined. 
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figure 2 

FLOW OF TUITION INCOME AND FUNDS TO 
SUPPORT FINANCIAL AID PROGRAMS 
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The research imported In this paper is focused on the 
attitudes and orientation which students have toward var- 
ious philosophies, purposes, and processes of a college 
education. Even to casual observers of the higher education 
scene, it is well known that our colleges and universities 
enroll individuals with tremendously different back* 
grounds, interests, and abilities. As Cross (1971) indicates, 
institutions arc faced with an increasingly heterogeneous 
student population. What arc the Interests and learning 
orientations of our students? What arc their attitudes about 
the curricular-instructlonal policies which affect them? 
What kind of educational processes do they desire? More- 
over, what relationship exists between students' cduca* 
tional attitudes and their patterns of growth in both the cog* 
nltlvc and non-cognitiyg domains? These have been and 
will continue to be major questions at institutions of higher 
learning, although to date little effort has been focused on 
these particular areas of Inquiry. 

This is not to say that little has been done in the area 
of research on college jtudents, To the contrary, Feldman 
and Newcomb (1069) have reviewed and compiled a mas- 
sive number of research studies which have been under- 
taken over the last four decades. Mechanisms to exist 
for determining general characteristics and attitudes of 
students — the American Council on Education's Survey of 
Entering Freshmen and the College Student Questionnaire 
(Peterson, 1965) are prime examples. Research on student 
perceptions of the college environment performed by Pace 
(1963) and Stern (1963), personality characteristic studies 
(Heist and Yonge, 1968), student "satisfaction" studies by 
Pervin (1967), Betz, ct. at, (1971) are valuable in their 
own right. However, these types of research studies do not 
necessarily involve consideration of the implications of cur- 
ricular-instructional situations since for the most part, the 
research inventories employed do not deal directly with 
students' attitudes regarding educational processes and 
policies. 

Thus, the first task in this project was one of devis- 
ing an instrument appropriate for our purposes, namely, 
providing a way to assess students' attitudes regarding their 
preferred modes of teaming, their views on student-faculty 
roles In educational decision-making, and so on. After ex* 
tensive pre-testing of items and factor analyses (principal 
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components), these efforts culminated in the development 
of the Student Orientations Survey (Gray and Morstaln, 
1970) and this inventory was used in this inter-institutional 
research study, There are ten scales in the Student Orienta- 
tion Survey (SOS) with each scale consisting of eight items, 
Each item has four Likert-typc response categories, ranging 
from "not at all like my attitude" to "closely reflects my 
attitude." 

Before presenting some attitudinal profiles of stu- 
dents in different institutions and/or different degree pro- 
grams, it would be helpful to give a brief overview and des- 
cription of the SOS scales, 1 The SOS assesses five major 
dimensions or areas of student orientations to college, and, 
as noted below, each dimension is comprised of two cor- 
responding scales. The dimensions and scales arc as 
follows: 



Table I 

STUDENT ORIENTATIONS TO COLLEGE 
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Given the pattern of scale intcrcorrelatlons, one set 
in five scales clustered together in what has been inter- 
preted as a general "Preparatory" orientation to college, and 
another set of five scales were related to a general "Ex- 
ploratory" orientation to college. That is, it appears that 
while college is most highly valued by some for its 
preparatory function — in terms of acquiring useful know- 
ledge, skills, vocations, and social rotes — it is valued most 
highly by others for its expiatory possibilities — i.e.. for 
the opportunities it affords for exploring one's interests, 
ideas, and personal identity. These general orientations be- 
come more apparent when one examines the content and 
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figure 1 

SOS PROFILES FOR FIVE INSTITUTIONS 
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description of the ten scales. The five scales which deal 
with the "Preparatory" orientation arc: 
Achievement (ach.) 

This scale measures the degree to which a student is 
oriented toward (1) the achievement of o priori goals 
(usually some career in particular or success in 
general), (2) the acquisition of specific skills or cre- 
dentials, (3) the satisfaction of receiving external re- 
wards, The student who identifies with the contents 
of these items has a practical, goal -oriented outlook 
and tends to gauge various aspects of the college ex- 
perience in terms of their future usefulness. 
Assignment Learning (A.L.) 

The student who agrees with a high proportion of the 
items on this scale reports that he learns best by 
meeting specific, clear-cut, formal requirements. His 
mode of learning Is linear, i.e., he likes to master 
specified blocks or units of knowledge sequentially. 
Assessment (As.) 

An evaluation by those in authority seems to be quite 
important to the student who scores high on this 
scale. Grades and examinations are valued by this 
student because they provide not only some measure 
of his abilities but some incentive for using those 
O bilities. 

ERIC 



Affiliation (Affl.) 

The student who prefers the manner of rotating to 
peers expressed in items on this scale enjoys belong* 
ing to organized extracurricular groups. He appears to 
value the assurance of friendships such affiliation 
provides. Furthermore, he stresses the importance of 
maintaining strong Institutional loyalty and support. 
A//frmat/on (Affr.) 

The student who agrees with items on this scale ap- 
pears to affirm the values of a peaceful and orderly 
society. Ho lends to support public officials in their 
commitment to solve civic problems and feels "the 
majority can be counted on to make the right deci- 
sions," He would probably counsel care and caution 
in the area of social change. 

The five 8-item scales which deal with the Exploratory 
Orientation are: 
inquiry (Inq.) 

"Learning is its own reward '— in essence, this is the 
expressed motivation of the stude.ii who responds 
positively to most of the items on this scale. He 
concurs with statements which stress the value of in- 
sight, the perception of relationships, and knowing 
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how to learn, He expresses curiosity about many 
things and appears to enjoy the satisfaction of inquiry 
whether or not It brings with it any other reward. 
Independent Study (LS.) 

Tho Items on this scale help to identify the student 
who works bost on his own, Ho prefers informal, un- 
structured coursos In which ho can set his own goals 
and standards and pursue his own interests. Ho ap- 
pears to ptaco a high value on freedom and inde- 
pendence, 
/ntoracfJon f Inter,) 

An egalitariln attitude toward faculty members char- 
acterizes thr student with a high score on this scale, 
Tho individual seoo students as fully competent to 
sharo educational decision-making with faculty. In 
this connection ho expresses tho belief that students 
should pjrticipato with faculty in planning courses 
and academic programs, 
Informal Association (LA,) 

Spontaneity marks tho pattern of peer-relationships 
expressed by tho student who responds favorably to 
' thifv cluster of items, Ho expresses lilllo need' for 
affiliation with organized groups or for participation 
in formal, well-planned events, His association with 
fellow-students also tends to bo unstructured, 
Involvement (Inv.j 

A strong Interest In social and political affairs charac- 
terizes tho student who has a high score on this scale. 
Ho sees students as having a rightful placo in dealing 
with the public problems of our time, Further, he ox- 
presses a concern for tho welfare of olhers and states 
his readiness to take a stand on public issues. 

Result', 

Over the course of this pilot study, undergraduates at 
eight colleges and universities wore administered the 
Student Orientations Survey (total N*4279) J , At this point 
in the research project, the goal was to determine tho de- 
gree to which tho SOS could differentiate between students 
in various institutional settings and/or curricular programs, 
In this regard, SOS profiles for students in five different 
institutions aro presented in standard score form In Figure 

For theso institutions, the SOS means on tho Prep- 
aratory scales show somewhat more variability than do the 
mean scores on the Exploratory scales. Students at Sten- 
benvillo Collego (N« 149), Harcum Junior College (N«92), 
and Concordia College (N-718), all private institutions, 
tend to have higher mean scores on the Preparatory scales 
of the SOS than do students at Muhlenberg College (N» 
425) and the University of Delaware (No 2448), With one 
exception (Muhlenberg's score on Affiliation), these latter 
two institutions have scores on all Preparatory scales below 
the five-Institution mean, 

For the Exploratory scales, there is somewhat less 



variability In mean scores on tho Independent Study, Inter- 
action, and Involvement scales, 1 Across tho five insti- 
tutions, however, there is more noticeable variation In 
mean scores on tho Inquiry end Informal Association 
scales. 

It was also hypothesized thai the SOS profiles for 
students in different curricular arces would show as much 
if not more variability than intcr-lmititutional comparisons. 
As there were fairly largo Ns in five distinguishable curri- 
cula at tho University of Delaware, a curricular program 
analysis was performed with date from tho institution, SOS 
profiles for students majoring !/« tho following areas aro 
presented In Figure 2: social sconces (N»433), natural sci- 
ences (N*317), humanities an «! fine arts (N-317), pre- 
dominantly male professional curricula — Engineering, 
Agriculture, Business (N«628), and predominantly female 
professional curricula — Nursing, Homo Economics, and 
Education (N»723). 

Students in tho social sciences and humanities had 
relatively lower mean scores on all Preparatory scales than 
students In the other three curricular areas, Tho profile for 
students in the natural sciences was slightly below \)w 
normative mean score of 50 on theso scales, and was mid' 
way between tho profiles for students in male, professional 
curricula and those students majoring in social sciences 
and humanities. 

Overall, there was moio curriculum group variation 
in mean scores on tho Exploratory scales as compared to 
tho Intcrinstitulional profiles previously presented. Human- 
ities and social science majors expressed relatively more 
Interest in having a participatory role with faculty in 
educational decision-making (Interaction), had more desire 
in developing "learning contracts" and other independent 
study or off-campus experiences (Indcp. Study), and 
tended to view learning as its own reward, whether or not 
this learning had a practical or vocational pay-off (Inquiry). 
Humanities majors also had the highest mean score on the 
Informal Association scale (a desire for unstructured, spon- 
taneous peer-relationships) while social science majors, as 
might be expected, had the highest mean score in the 
Involvement scale (interest in socio-political issues). On 
tho other hand, students In tbo male professional curricula 
had tho lowest mean scores of all five Exploratory scales/ 

In a related domain, previous research on students 
who "self-select" themselves into experimental programs 
had indicated that these students' general characteristics 
and personality orientations are substantially different 
from those of their peers In the regular curriculum (Heist 
and Bitoursky. 1971; Suzcek and Alfert, 1970), It was hy- 
pothesized that differences in educational attitudes and 
orientations would also be evident for students in these two 
settings. SOS profiles for freshmen in traditional liberal 
arts curricula and freshmen who voluntarily participated in 
experimental programs at both the University of Hawaii 
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and SI. Otaf's College are presented in Figure 3. 

Al each institution, the freshmen in the experimental 
program had higher mean scores on the Exploratory scales 
of the SOS when compared to their peers In the regular 
curriculum. Conversely, the experimental program students 
had lower mean scores than did their peers on the Prepara- 
tory scales. There were atso substantial differences on cer- 
tain scales when students In the two experimental pro- 
grams and students in the two traditional curricula were 
compared on an /nlcr-institutlonal basis. 

For example, freshmen in the experimental Para- 
College program at St. Olaf's College had higher scores on 
four of five Exploratory scales of the SOS when compared 
to students in the New College experimental program at the 
University of Hawaii. In addi'Kn, freshmen in the regular 
academic curriculum at St. Ola* s College had lower mean 
scores on the Achievement, Affirmation, Independent 



Study, ind Interaction scales when compared to their 
counterparts in the regular freshman year program at 
Hawaii, That there would bo variation of this sort is not 
surprising as the two institutions are quite dissimilar with 
respect to size, orientation, and admissions policies. 

Discussion 

Based on analyses of the data presented, the SOS ap- 
pears to be sensitive to the differing educational attitudes 
expressed by students in various institutional settings and 
curricular programs. This descriptive capability generally 
relates to the validity dimension of the SOS, as well as to 
the question of how the inventory can be used by re- 
searchers in the field of higher education. For example, one 
aspect of the impact or effectiveness of an academic pro- 
gram could be based in part on an analysis of the long!* 
tudinal changes in students' educational attitudes {Mor- 
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slain, 1973b). 

Other research studies recently completed have also 
focused on the validity of the SOS. Pemberton (1973) has 
shown that students with various patterns of scholastic ap- 
titude (as measured by SAT scores) have significantly dif- 
ferent SOS profiles. Morstain (1973c) administered the Om- 
nibus Personality Inventory and the SOS to a sample of un- 
dergraduates at three institutions and reported that stu- 
dents* educational attitudes were directly related to their 
genera! personality characteristics and orientations. In 
order to assess the relationship between individual orienta- 
tions and perceptions of the collegiate environment, re- 
search studies employing the SOS and CUES and/or the 
Institutional Functioning Inventory would be of value. 
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Much discussion has cJso centered on the question 
of the relative "fit" of student and faculty educational atti- 
tudes, and what bearing this may have on student develop- 
ment. What is the decree of congruence or incongruence in 
educational attitudes and values for faculty and Students, 
either in one class, one department, or the institution as a 
whole? This type of research may have implications for 
attempts to empirically validate hypotheses generated by 
the "challenge and response" conceptualization of student 
growth (Sanford, 1967). 

From this theoretical perspective, gaining a better 
overview of student attitudes is only one side of the picture. 
Hence, a ' Faculty Orientations Survey" has been recently 
developed in order to provide a means of assessing a 
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faculty member's educational altitudes and teaching 
orientations. 1 The items in this new inventory, with appro- 
priate changes, correspond quite closely to Items found In 
the SOS. In a study which was Initiated In April 1973, re* 
searchers at the University of Delaware are exploring the 
degree of student-faculty congruence in educational atti- 
tudes and what relationship a "disparity" factor has with 
respect to how students evaluate their courses and Instruc- 
tors. The hypothesis under consideration Is that the higher 
the degree of student-faculty attitude incongruence, a 
student's course/instructor ratings will be relatively lower 
when compared to the ratings of students in a "high con- 
gruence" situation. 

Obviously, a hoat of other research questions could 
be developed (i.e. What are the educational attitudes of 
students who change academic majors or programs? What 
are the attitudes of student* who withdraw from a college- 
or university?). In sum, the type of research reported or 



suggested In this paper may have Implications for Consider- 
ing an Institution's academic policies and practices with 
reference to the question of educational outcomes. That Is, 
many would argue that a college or university should place 
high priority on helping students assume responsibility for 
developing the kinds of educational experiences which are 
most appropriate to their particular goals, Interests, and 
needs. In many respects, this concern is related to White's 
(1952) concept of the development of a ''sense of com- 
petence" — » in this case, that a student can have some say 
as to the nature of his academic experiences by taking an 
active role In shaping his own education. If a more per- 
sonalized educational system is to occur, examining the 
education attitudes and orientations of students and faculty 
will of necessity assume more substantive priority in higher 
education research. Hopefully, a better understanding of 
leacher-sludent relationships and the effectiveness of 
various educational processes will result from these efforts. 
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1 F values from the analysis of variance on each scale wen; significant at tho p < 01 level, with lhi» exception of ihc Independent Study 
scale (p < 05). 

1 F values from tho analysis of variance on each scab were significant at tho p <,ot level. 
* Copies of tho SOS and FOS inventories are available from the author. 
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At a time when most colleges arc experiencing en- 
rollment decreases and concomitant financial pressures, in- 
creased concern is placed upon student attrition. A recent 
national study by the American Council on Education indi- 
cated that approximately fifty>three percent (53% ) of the 
entering freshmen do not achieve a baccalaureate degree in 
four years from the institution they entered as a freshman. 1 
Approximately forty percent of the entering freshmen in 
four-year colleges do not complete a baccalaureate degree 
within five years of enrolling in college.-* Colleges have be- 
come interested in the dropout, or thi; more recently de- 
fined stopout student, to determine ways in which the rate 
of attrition might be decreased. 

The college dropout has been the subject of con- 
siderable research during recent years. Since most empiri- 
cal studies of dropouts have been carried out either at 
single institutions or at the national level, with differing re- 
search methodologies, the findings are rarely comparable 
and cannot be applied to institutions in other settings. In- 
consistencies in the findings of attrition studies may result 
from different populations, different institutional settings, 
varying definitions of dropouts, different research designs, 
insufficient data on the student and the college environ- 
ment, and a relatively high nonresponse rate. The high nor- 
response rale is a common research problem in studies of 
students who have withdrawn from college, since such 
studies are closely linked to college experiences which may 
be viewed negatively. The inability to distinguish between 
students who Withdrew with unsatisfactory academic aver- 
ages and those who withdrew in good academic standing is 
a severe limitation in interpreting the results of many 
studies. 

Selected Studies of Attrition 

Three studies of dropouts provide significant contri- 
butions to the research literature for their methodology, 
breadth of $cope, and general quality: Alexander \V. Astiri's 
College Dropouts: A National Profile*: a study by Jerald 
Bachman and others. Youth in Transition — Dropping 
Out 4 ; and a study by Robert Cope and others entitled Ah 
Investigation of Entrance Characteristics Hclatcd to Types 
of College Dropouts.* 



College Dropouts: A National Profile 

The purpose of Astin's research was to determine 
national dropout rates among full-time students attending 
two-year colleges, and four-year colleges and universities. 
For students attending four-year institutions, Astin used 
four measures of persistence:* 

1. Kn roll men t for at least a second undergraduate year; 

2. Receipt of a baccalaureate degree or its equivalent 
within four years of entry; (47% of the students 
received the baccalaureate degree within four years.) 

3. Continued enrollment for work toward a degree in the 
same institution; (12% of the students were included 
in this category.) 

4. Withdrawal from the inital institution with a sub- 
sequent request for a transcript sent to another 
institution. Apprt mately twenty percent of the 
students in Astin's study were included in this 
category. 

These measures classify as dropouts only those 
students who left their first institution without completing 
a degree and who never requested transcript be sent to 
another institution. Using this definition, approximately 
twenty percent (20% ) of the students in Astin's study were 
classified dropouts. When the forty-seven percent of the 
entering freshmen who completed a degree within four 
years is combined with the twelve percent (12% y who are 
still enrolled, a persistence rate of nearly sixty percent is 
achieved for students at four-year colleges and uni- 
versities, 7 While Astin found the national dropout rate to be 
somewhat lower than had been suggested in other studies 
(MeNolly"; Iffort q ) approximately forty percent (40% ) of the 
entering freshmen at four-year colleges do not complete a 
baccalaureate degree within five years of entrance. 

Youth in Trasition — Dropping Out 

V The Youth in Transition research a longitudinal 
study of high school youth, identifies factors which predict 
dropping put and determines the relationship between ottri* 
lion and changes in self-esteem, self-concepts of ability, 
occupational aspirations, and delinquency. IJachman con- 
sidered a commitment to education as a broader dimension 
than one which distinguished dropouts from pcrslslcrs. The 
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students who fell education was very important were not 
only less likely to dropout, they were also more likely to 
extend their education beyond high school, 10 Consequently, 
Bachman conceived educational attainment as a continuum 
between high school entrance and post-high school educa- 
tion. The treatment of educational attainment as a con- 
tinuum assumes that most factors which relate to dropping 
out of high school also relate, in an opposite direction, to 
extending one's education beyond high school. In his 
analysis, three groups of students were located on this scale 
of educational attainment: at one end of the continuum 
were the dropouts, at the other end were those who have 
entered college or other post-high school education, and be- 
tween them were the non-collcgc-bound high school 
graduates." 

. Identifying educational attainment as a continuum is 
an important tool because it differentiates among high 
school students who continue their education beyond high 
school and those who do not. If no distinction were made 
between these two groups of persistcrs at the high school 
level, it would be possible to make an interpretive error be- 
tween dropouts and students who stay in high school, 
when it is more meaningful to differentiate within the two 
groups of persisting high school students. 

This methodology may be applied to any institution 
wishing to make distinctions within ils student body. For 
example, two-year institutions could apply the method- 
ology to differentiate among students who do and do not 
enter four-year institutions. Similarly, colleges could use 
this technique to distinguish between students who do and 
do not continue to graduate school or other important post- 
graduation activity. 

Before reviewing Cope's studies, it seems pertinent 
to discuss the use of psychological and institutional vari- 
ables in research on attrition. Recent studies utilizing the 
standardized psychological inventories such as the Minne- 
sota Multiphasic Personality Inventory, the California Psy- 
chological Inventory, and the Omnibus Personality Inven- 
tory have shown that some psychological variables arc re- 
lated to college attrition, The research has shown sub- 
stantial differences between dropouts and persistcrs and 
the findings illustrate; the potential merit of considering 
psychological differences. A study by Rossman and Kirk at 
Ihp University of California at Berkeley differentiated be- 
tween "voluntary withdrawals" — students with grade 
point averages of 2.0 and above and "academic failures" — 
students With grade point averages below 10 u By dis- 
tinguishing between these two types of dropouts, Rossman 
and Kirk found that "voluntary withdrawals" scored 
hificantly higher than the Berkeley sophomores on two in* 
tellectual orientation scales', thinking introversion and cs- 
thcticisnv and lower on the practical outlook scale. The 
adores of the "academic failures" were slightly, but not sig- 
nificantly lower than the persisting students on the two in- 



tellectual orientation scales and slightly higher on the prac* 
tical outlook scale. The use of psychological tcsls reveal dif- 
ferences between types ol dropouts and types of persistcrs, 
re-cmphasizing that dropouts should not be considered as a 
single group of students, 

A growing body or research focuses on the relation- 
ship of the college environment, the individual's adjust- 
ment to college, and the process of dropping out. Several 
researchers have used the concepts of personal need and 
environmental press as a technique to study personal ad- 
justment in college. 13 Using this approach, students are 
viewed as having certain needs with the strength of these 
needs characterized by one's personality. The college en- 
vironment has the potential for satisfying or frustrating the 
needs of the student. The term "environmental press" is 
applied to the colleges potential to satisfy or thwart indi- 
vidual needs. 

Environmental presses have been defined in terms 
of psychological characteristics — the need for order, a 
tolerance of ambiguity, practical orientation, intellectual 
orientation, and several others. When there is a discrepancy 
between personal needs and the ability of the environment 
to satisfy those needs, a student is more likely to dropout 
than a student who experiences a congruent relationship 
between his needs and environmental presses. Examples of 
studies using an institutional environmental approach arc 
the previously cited research by Rossman and Kirk and 
Robert Cope. 

An Investigation of Entrance Characteristics Related to 
Types of College Dropouts 

The work of Robert Cope and others includes two 
studies, one at the University of Michigan during the mid- 
1960's and the other at the University of Washington in the 
early 1970's, institutions which were found to have similar- 
student characteristics at the time of the research, In these 
studies, characteristics of the college environment wore re- 
lated to typologies of college dropouts. 

Two major presses within the college environment 
were the social and academic. A social press was defined 
on the basis of demographic and atlitudinal information 
such as the students' socioeconomic status, interest in 
sodal life, politics, esthetics and other items. An academic 
press was defined in terms of scores on measures of aca- 
demic ability and personality orientations such as the Om- 
nibus Personality Inventory," The two dominant dropout 
typologies included those students who dropped put for 
social reasons, and those who left for academic reasons. 
Examples of academically-related reasons for leaving in- 
cluded a lack of Intellectual challenge, fear of failure, or 
actual failure. ' 

The research suggested that students may be incon- 
gruent with either or both of these major environmental 
presses. In such CasdsJ students may choose to leave the 
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institution, voluntarily or involuntarily, or may remain at 
the institutions, depending upon the press and (he per- 
sonality trait being considered. Cope's data reveals that the 
social-psychological attributes of students differentiate be- 
tween pcrsistcrs and dropouts in institutions which have 
relatively unique social and/or academic presses, 

The typologies were effective methodologically in 
evaluating dropouts at bolh the Univeristy of Michigan and 
the University of Washington and may be applicable at 
other institutions. Cope emphasized the necessity of dif- 
ferentiating within the total dropout population in order to 
recognize the complexity of the dropout phenomenon. For 
example, the relationship between the reasons for dropping 
out and the characteristics of the students who dropped out 
emerged only after the entire group of dropouts was analy- 
zed for within group differences and such a typology and 
personality factors. 

The institutional environmental approach appears to 
be a promising development In the research on student 
attrition. At the time the study by the Minnesota State Col* 
lege System was performed, psychological and institutional 
environmental data was not available. While there has been 
extensive research on attrition performed at major institu- 
tions such as the University of Michigan, Washington, and 
the University of California at Berkeley, similar research on 
dropouts within state colleges has received limited atten- 
tion. The research within the Minnesota State College 
System may provide a comparative base for other studies 
Within state colleges. 

Results of the Minnesota State College Research 

The Minnesota State College System undertook a 
study of students who had withdrawn from the six state 
colleges during the fall 1971 quarter. The purpose of the 
study was to provide demographic and attitudinal informa- 
tion on the dropouts and to identify factors contributing to 
student withdrawal. Examples of the desired information 
Were the student's academic background, attitudes toward 
their educational experience, reasons for withdrawing, 
post-college activities and future educational plans. 

The sample Included Minnesota residents enrolled 
as full-time students during fall 1971 who did not re-enroll, 
for the winter 1972 quarter. 1 s Of the 2,493 Minnesota resi- 
dents who withdrew during or immediately after the fall 
1971 quarter, 2,114 or 85% were included in this study, 
Demographic and academic data on the 2,114 students were 
provided by the colleges. Questionnaires were mailed to an 
effective sample of 1.841 students. Forty percent of the 
questionnaires (729 of 1,841) were returned. 

The following information describes the character- 
istics of the total group of dropouts Compared with the 
characteristics of full-time undergraduates in the Minnesota 
State College System and the results of other attrition 
studies were pertinent. Additional data regarding the Char- 



acteristics of dropouts and the general student body are 
available from the author. 



Age: 



Sex: 



Marital Status: 



High School 
Rank: 



ACT Scores: 



Twenty-seven percent of the dropouts 
were twenty-two years or older, which Is 
identical to the age distribution of stu- 
dents enrolled in the Minnesota State 
Colleges. In other studies of dropouts, 
age differences were relevant only 
for those institutions which have a signi- 
ficant proportion of older students. The 
importance of the age variable lies in 
the increased experience; and diversified 
family and related demands and respon- 
sibilities that older students experience. 

Fifty-four percent of the dropouts were 
men and forty-six percent were women — 
the samr proportion of men and women 
enrolled in the state colleges. Attrition 
studies which have controlled for sex as 
an independent variable report con- 
flicting findings, although the sex vari- 
able helps identify and explain dropout 
behavior when used in conjunction 
with other variables. 

Seventeen percent of the dropouts were 
married, compared to only 12% of the un- 
dergraduate student body. Half of those 
who were married supported dependents. 
Other studies have noted that married 
students tend to withdraw more fre- 
quently than unmarried students. 



Sixty percent of the dropouts were in the 
top half of their high school graduating 
class. The dropouts had a slightly lower 
high school rank than the students ert- 
rolled in the State College System. Con- 
sistent with other studies, there is gen- 
erally a positive relationship between 
high school class rank and persistence in 
college. 

The median ACT composite score for the 
dropouts was 20 vyhlch approximates the 
median score of the students in the State 
College System. Other research has 
shown that dropouts usually have lower 
aptitude test sec res than students cprHinu- 
ing Iri college. 
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Sixly-two percent of the parents had not 
attended college. No comparative data for 
the undergraduate student body are avail- 
able. 

The median parental income at the time 
of entering college was $7,500 which 
approximates the parental income of 
the general student body. Other studies 
have indicated a trend which shows that 
the higher the socioeconomic status of 
the family, the higher the probability 
of graduating from college. It should be 
remembered, however, that there is 
an interdependent relation between edu- 
cation, occupation, and income. It is not 
any one of these factors alone which is re- 
lated to persistence in college; it is rather 
the combined result of education, occupa- 
tion, and values and, subsequently, on 
the socialization of the child. 



Although fewer than half of the students 
were financially dependent upon their 
parents, slightly more than half of these 
students (54% ) indicated parental in- 
comes of $3,000 or less. Comparable data 
for the undergraduates enrolled in the 
Minnesota State Colleges are not avail- 
able. 



Over half of the students who dropped 
out were financially self-supporting — a 
much higher incidence of self-support 
than occurs in the undergraduate student 
body. The financially independent stu* 
dents were generally older, married, and 
had dependents, Over half of the self- 
supporting students indicated incomes of 
$9,000 or more. 



Sixty-nine percent of the dropouts had 
grade point averages of 2.0 and above at 
the lime if withdrawal, with a median 
average of 2,6 after atrnost two years of 
study. In contrast, the dropouts with un- 
satisfactory academic averages — 31 per- 
cent of the total group of dropouts — had 
a median grade point average of 1.5 after 
only one year of study, (h comparison. 68 
percent of the studcrtfs enrolled in the 



Minnesota State College System had 
cumulative grade point averages of 2,0 
and above, while 42 percent averaged 1.9 
or lower. The data indicate that the drop- 
outs had higher academic averages than 
the currently enrolled students. 



In general, the results support the findings of the 
Astin and Cope studies that lower scores on measures of 
academic ability, as defined by high school rank and test 
scores, and lower levels of parental education are related to 
attrition. 

Tables 1 and 2 compare the dropouts in the Minne- 
sota State College System on several significant biograph- 
ical and academic items differentiated by sex and grade 
point average (Table 1), and combinations of these vari- 
ables (Table 2). Students with grade point averages of l.g or 
less have been identified in the tables as "academic fail- 
ures/' and those with academic averages of 2.0 as "volun- 
tary withdrawals." 

Reasons For Dropping Out 

Students rated ten statements commonly given as 
reasons for leaving or dropping out of college as being 
"very important," "somewhat important," or "an unim- 
portant factor" in their decision to withdraw. The four 
reasons rated as either "very" or "somewhat important" in 
the decision to withdraw were the following: 

— Insufficient financial resources: 48% 

— Disappointed with the academic program: 48% 

— Unhappy with the college experience; 47% 

— Academic program not available: 38% 

(Since students could indicate more than one reason as 
"very" or 'somewhat important," the percentages exceed 
100% ). 

A factor analysis of these four items indicates three 
distinct reasons for withdrawal; the lack of financial re- 
sources; a general disappointment with the academic 
program combined with a general unhappincss with the 
college experience; and the unavailability of the academic 
program in which the student was interested. 

However, three factors appear unique in the study of 
dropouts of the Minnesota State College System: 
\. The importance of insufficient financial resources as a 

reason for dropping out Was related to a reluctance to 

apply for financial assistance. 

2. The relatively large group of dropouts who were self- 
supporting. Other studies of dropouts havo riot dis- 
tinguished be tvv e e n financial dependence a n d 
independence. 

3. The general disappointment with the academic pro- 
gram arid unhappiness with the college experience. 
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Table 1 

COMPARISON OF 8IOCRAPHICAL AND ACADEMIC VARIABLES 
AMONG DROPOUTS BY SEX AND GRADE POINT AVERAGE 



Biographical and 

Afarfpnrilf VariaHlp< 


SEX 


GRADE POINT AVERAGE 


Men 

K.I hpi 

IN= 1151 


Women 
N»963 


t 


Academic 
Failures 
N«507 


Voluntary 
Withdrawals 
N«1134 


t 




> 20 yrs 


< 20 yrs 


8.36* • 


< 20 yrs 


> 20 yrs 


5.00** 


Sex 


~~ P 






Failures W€ 


• 1 1 IUI IT 












likel v to he 


men 




111511 dCriOOl K4HK 


Third 


Second 




Third 


Second 






Quartile 


Quartile 


5 52° 


On art Hp 




3./ * 


ATT tt\a\ IcK 














M 


16,2 


18.9 


10.25** 


16 1 


1fl ft 

IDrV 


J .7 J 


SO 


5.2 


5.4 




5 1 

J. 1 


J.J 




ATT llslk 

At 1 Main 














M 


19.1 


18.2 


2,68* 


17,4 


19.1 


4.33** 


SD 


7.0 


67 




6.6 


7.1 




ACT Composite 














M 


19.2 


19.6 


157 


16.0 


20.1 


6,98* • 


SD 


5.5 


5.2 




5.0 


5.5 




Qtr. Hrs Competed 














M 


74,2 


717 


0.97 


47.9 


87.3 


13.86" 


SD 


54.3 


54.9 




397 


582 




Satis/action with 


Men were 


less 




Failures we 


re Jess 




Academic Program 


satisfied 




1.26 


satisfied 




3.41* 


GPA 














M 


2.06 


2.46 


12.05** 


1.46 


2.59 


45.36" 


SD 


.64 


70 




42 


.48 





Note * The means and standard deviations or the direction of the difference between 
men and women, or academic failures and voluntary withdrawals ate reported above. 
The direction of the difference Is indicated if the mean of the variable was not self- 
explanatory. The number of respondents varied With each Item. 
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Table 2 

COMPARISON OF BIOGRAPHICAL AND ACADEMIC VARIABLES 
FOR ACADEMIC FAILURES AND VOLUNTARY WITHDRAWALS BY SEX 



RiOffrjnhtf il mH 

MiV|jr« piitvai Ainu 
Ac Afiemlc Varl^hlpt 

f^VflUvllllV TfilfUIC) 


MEN 


WOMEN 


Academic 
Failures 
N » 361 


Voluntary 
Withdrawals 
N ae 532 


t 


Academic 
Failures 
N as 146 


Voluntary 
Withdrawals 
N m 601 


t 


Age 


20 yrs 


> 20 yrs. 


5.67 ••• 


19 yrs. 


20 yrs 


4.43* " 


High School Rank 


Third 


Second 




Third 


Second 






Quartile 


Quartile 


2.14* 


Quartile 


Quartile 


4.31"* 


ACT English 














M 


15.5 


16.9 


3.46* M 


17.6 


18.9 


2.46« 




5.1 


5.2 




5.0 


5.6 




ACT Math 














M 


18.0 


19.9 


3.51 ••• 


15.8 


18.5 


4.00«" 


5D 


6.6 


7.4 




6.3 


6.7 




ACT Composite 














M 


18,2 


20.2 


4.94" • 


17.4 


20.0 


5.08'" 


SD 


5.1 


57 




4.6 


J.4 




Qlr. Hrs Completed 














M 


51.0 


93.8 


12.15"* 


40.4 


81.5 


8.20* 


SD 


39.5 


58.5 




39.2 


57.3 




Satisfaction with 


Failures wer< 


» (ess 




Failures w 


ere less 




Academic Program 


satisfied 




1.96* 


satisfied 




288" 


CPA 














M 


1.47 


2.46 


34.92* M 


1.45 


2.70 




SO 


.42 


.41 




.42 


.51 












27.49 Mi 



Note * The means and standard deviations or the direction of the difference between the 
academic failures and voluntary withdrawals for men and women are reported above. 
The direction of the difference Is indicated if the mean of the variable was not self- 
explanatory. The number of respondents varied with each item. 

♦ p * < ,05 
• * p * < ,01 
•" p » <.001 
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Insufficient Financial Resources as a Reason for Dropping 
Out 

The dropouts were separated Into two groups on the 
basis of financial dependence, Fifty-four percent (54% ) of 
those who were dependent on parental support came from 
families with incomes of $3,000 or less. Within this group, 
only fifty-one percent (51% ) applied for financial aid and 
seventy-six percent (76% ) received assistance. Seventy-five 
percent (75% ) of the financial aid recipients indicated that 
the amount of assistance was sufficient to meet their rea- 
sonable financial needs. Despite the low parental income 
level, a relatively small percentage, only sixty-three percent 
(63% ), indicated the lack of financial resources as an im- 
portant reason for withdrawing from college. Why did such 
a small percentage of students from low income families 
apply for financial aid? Among possible explanations are 
the following: 

1. Students from low income families percievo a low 
potential for success in college and are reluctant to 
apply for financial assistance, 

2. A strong protestant ethnic of self-support exist3 among 
students from tow income families. A large number of 
students work part-time while in college. Rather than 
apply for financial aid, these students would prefer to 
withdraw or stopout when their resources depleted, 
earn additional money, and then return to college. 

3. An unawareness that financial aid is available. 

4. A reluctance to apply for or accept loans since low 
income families have a history of indebtedness. 

One might anticipate that a large percentage of ihe 
students who indicate financial independence have low 
Incomes. However, In the Minnesota State College study, 
only eleven percent (11% ) of the self-supporting students 
had incomes of $3,000 or less. Sixty-two percent (62% ) of 
the self-supporting students reported incomes exceeding 
$9,000. Only thirty-four percent (34%) of the self-support- 
ing students applied for financial assistance. 

When the total group of dropouts is differentiated 
into groups by sex and grade point average below and 
above 2.0, and then combinations of sex and grade point 
average, the problem of financial resources is shown to be 
related to certain groups of dropouts. Tables 3 and 4 com- 
pare the dropouts or) the reasons for leaving college by sex 
md grade point average (Table 3), and combinations of 
these variables (Table 4). 

the data in Tables 3 and 4 show that the lack of 
financial resources was a more important problem for men 
than for women, and specifically for men with satisfactory 
academic averages. The most important reason given for 
dropping out among meft with Satisfactory grade point 
averages was a lack 6f financial resources, in contrast* men 
with unsatisfactory academic averages ranked Insufficient 
financial resources fourth, after low grade, uhhappihess 
With the college experience, and d disappoint the 



academic program. 

The three most important reasons for women leaving 
college were a disappointment with the academic program, 
a lack of financial resources, and an unhappiness with 
college as the three most Important reasons for dropping 
out. 

Many of the attrition studies during the last twenty 
years Indicated that both men and women frequently cited 
dissatisfaction vlth the college environment, lack of In- 
terest in studies, uncertain academic major and undefined 
career plans as motives underlying the decision to with- 
draw. The major difference between two studies performed 
during the 1950s (Iffert™, and Slocum") and a study In the 
1960 s (Astin and Panose) is that the students in the later 
study were withdrawing more for reasons of dissatisfaction 
with the college environment and unsettled personal in- 
terests and goals. Over the past 15 or 20 years, there appears 
to be an Increasing tendency to cite personal factors related 
to dropping out — a lack of fit between the student and the 
institutional environment, and undefined personal objec- 
tives. This suggests that students today, in comparison with 
the students in the 1950's, are more concerned with the 
relevance of education to their personal growth and de- 
velopment. 

Attitude Toward the Academic Program 

Students who withdrew were generally satisfied 
with their educational experience although they believed 
the quality of instruction and the teaching-learning process 
could be improved, In response to a question about their 
academic program, thirty-five percent (35% ) were satisfied 
with their education, fifty-two percent (52% ) had mixed 
feelings, and thirteen percent (13%) were dissatisfied with 
their education. 

The quality of the faculty and course content were 
positively mentioned by twenty-two percent (22% ) of the 
students, yet a slightly higher percentage of students, ap- 
proximately twenty-seven percent (27% ), were dissatisfied 
with the Instruction and course content. Forty-two percent 
(42% ) of the students felt their courses were not as Intellec- 
tually challenging as they had anticipated. 

Nineteen percent (19%) of the students were dis- 
satisfied with required courses; thirteen percent (13% ) 
recommended elimination of general education courses or 
placing less emphasis on general education courses. 

The results of the study suggest several curricular 
areas to be examined: * 
*— the purpose and the value of general education 
courses; 

— the opportunity for students to begin concentrating In a 

major field as a freshman: 
— - thd need to maintain contact With students who have 
voluntarily withdrawn and who arc interested in con* 
tintilng their Education, through off-campus and 
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Table 3 

IMPORTANCE OF REASONS FOR WITHDRAWAL FOR DROPOUTS 
BY SEX AND GRADE POINT AVERAGE 



MEANS AMD STANDARD DEVIATIONS 



Imnnftifir £ of 

IIMUUI INII^ v VI 

Reason for 
Withdrawal* 


SEX 


GRADE POINT AVERAGE 


Men 

Na 333 


Women 
N088 


t 


Academic 
Failures 

Na167 


Voluntary 
Withdrawals 
N=402 


t 


Academic Program 
Unavailable 

M 

SD 


2.38 
.75 


2.30 
.83 


1.24 


2.33 
.76 


1 41 

.77 


11,1 


Low CPA 
M 
SD 


2.46 
.76 


2.72 
,56 


4.86* 


(#1) 
1.93 

.76 


2.85 
.43 


16.90"* 


To Get Married 
M 
SD 


2,90 
.38 


2.63 
,71 




5 PI 

.45 


/./ 1 

.63 


2.55' 


Disappointment with 
Academic Program 

M 

SD 


(#3) 
l.ll 
.78 


(#1) 

4,16 

.81 


ft OA 

0.84 


(#3) 
2.05 
.78 


(#2) 
2.27 
,79 


2.72* • 


Not Enough Monev 
M 
SD 


(#1) 
2.04 
.83 


(#3) 
2.27 
.81 


3.48*** 


2.15 
.80 


(#1) 
2.12 
.85 


0,43 


Health Reasons 
M 
SD 


2.81 
,51 


270 
.67 


2,36* • 


2.77 
.56 


2.78 
.57 


0.21 


Enlisted or Drafted 
M 
SD 


2.68 
,70 


2.92 
.37 


5.32* 


2.78 
.60 


2.82 
.55 


0.63 


Unhappy with 
College Experience 

M 

SD 


(#2) 
2,15 
.83 


(#2) 
2.21 
.83 


0,95 


(#2) 
1.99 
.84 


(#3) 
2.29 
.80 


3.68* *• 


Family Responsibilities 
M 
SD 


2.73 
.60 


2,58 
,72 


2.72* * 


2.68 
.65 


2.65 
.68 


0.47 


Unsatisfactory Housing 
M 
SD 


2.68 
.61 


2,64 
.64 


0.71 


2.67 
.63 


2.67 
,63 


0,12 



Note • * The numbers in parentheses Indicate the rank among the three most important 
reasons for withdrawal within each group. 



The code ranged from 1 to 3; 1 Reason was rated "very important;'- 2 « "somewhat 
Important;" 3 ± "not at all important" In the decision to withdraw, the number of 
respondents varied with each variable. 

' * p « < .05' - * 

*•* p % < of " . - 

***p * < .601 " : ' - 
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Table 4 

IMPORTANCE OF REASONS FOR WITHDRAWALS FOR 
ACADEMIC FAILURES AND VOLUNTARY WITHDRAWALS BY SEX 



MEANS AND STANDARD DEVIATIONS 



Importance of 
Reason for 
wnnurawai 


MEN 


WOMEN 


Academic 
Failures 
N=116 


Voluntary 
Withdrawals 
N 157 


t 


Academic 
Failures 
N=51 


Voluntary 
Withdrawals 
N=244 


t 


Academic Program 
Unavailable 

M 

SO 


2.41 
.71 


2.46 
72 


0.55 


2.15 
,82 


2.38 
.80 


1,70 


Low GPA 
M 
SO 


(#1) 
1.89 

70 


2.78 

.55 


10.09° 


(#3) 
2.00 
.67 


2.89 
.33 


13.12° 


To Get Married 
M 
SO 


2,92 
34 


2.88 
.43 


0.85 


2.76 
.62 


2.62 
' 72 


1,15 


Disappointment with 

/Maudlin rrugraiii 

M 
SO 


(#3) 
2.13 
79 


(#3) 
2.33 
76 


1.98 


(#2) 
1.88 
7i 


(#1) 
2.23 
.80 


2.63* 


Not Enough Money 
M 
SO 


2.15 
79 


(#1) 
1,94 
.85 


1.93 


2,16 
.84 


(#2) 
2.24 
.83 


0.54 


Health Reasons 
M 
SD 


275 
.59 


2.86 
.42 


1.70 


2.82 
.51 


2.73 
.64 


0.84 


Enlisted or Drafted 
M 
SD 


2.69 
,69 


2.64 
74 


0.54 


3.00 
.00 


2.94 
.33 


1.18 


Unhappy with 
College Experience 

M 
SD 


(#2) 
2.07 
.86 


<#?) 
2.25 
.80 


1.56 


(#1) 
1.82 
.78 


(#3) 
2.33 
.80 


3.86° 


Family Responsibilities 
* M 


2.69 
.67 


275 
,55 


078 


2.66 
.63 


2.58 
.75 


0.60 


Unsatisfactory Housing 
M 
SD 


2.67 

'.. ; >63 


2.70 
.61 


0.42 


2.67 
,62 


2.66 
.64 


0.10 



Note • 1 The numbers In parentheses Indicate the rank among the three most Important 
reasons for withdrawal Within each group. 



The code ranged from 1 to 3; 1 « Reason was rated "very Important;'' 2a ''somewhat 
Important;" 3 «''n6t at all Important In the decision to withdraw, the number of 
respondents varied with each variable. 

' * p * < .01 

• : *♦ |j ss < .061 ' . 
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external studies programs. 

The purpose and value of general education and the 
liberal arts need to be examined in the context of Ihc ques- 
tions which students are facing today, questions involving 
the role of the liberal arts among a pragmatically oriented 
student body. Rather than require courses of all students 
within the first two years, an alternative might be an ar- 
rangement which would allow students to demonstrate a 
competency in the liberal arts prior to graduation. This 
would enable students who enter college intent on com* 
pleting a major the opportunity to take the courses in which 
they are interested rather than postpone the courses for two 
years. If the student were allowed, with the guidance of 
faculty, to design a series of experiences in the liberal arts, 
he should be able to develop a program of study Compli- 
mentary to a major area of study, an intended vocation, and 
larger societal concerns. 

By eliminating the general education or liberal arts 
requirements, faculty might have the freedom to design 
courses which may have greater appeal to students. An 
appreciation of the liberal arts cannot be attained through 
regulations. The college environment — the student, 
faculty, in and out of class activities — should compliment 
and encourage an interest in and appreciation of the arts. 

The vast majority of students who dropped out of the 
Minnesota State Colleges plan to continue their post- 
secondary education. Approximately forty percent (40% ) 
were enrolled in a college or vocational school during the 
immediate next quarter, and eighty percent (80% ) intend to 
enroll in a school or college during the next year. With such 
a large number of students planning to continue their 
education, we are dealing with a stopout phenomenon, one 
In which students temporarily withdraw from the formal 
post-secondary program to participate in more meaningful 
activities. For students who cannot continue as on-campus 
students, external studies arrangements provide an oppor- 
tunity for these individuals to continue to study and main- 
tain contact with the faculty and the college. 

Summary 

This paper has briefly reviewed selected research on 
college dropouts arid discussed the findings of several attri- 
tion studies. Dropping out of a college is a very complex 
process and comprehension of the problem requires a 
substantial amount of information about the student and 
the institution. The diversity within the dropout group 
indicates that dropouts should not be grouped into one 
category for analysis since the significant factors related tp 
the attrition of one group of dropouts will very likely be 
masked by the total group. At a minimum, distinctions 
should be made on grade point average, sex, and 



combinations of these variables, 

In addition to the importance of biographical, aca- 
demic, and psychological information on students, the re- 
search involving the relationship between the student and 
the college environment appears likely to have the most 
relevance in increasing our understanding of tho dropout 
phenomenon. The student-environmental fit approach 
simultaneously studies the effects of several biographical, 
educational, psychological, and environmental variables. 
To implement this approach, colleges will need to obtain 
psychological data on the student body, from which 
information about environmental press may be derived, 

Several findings from the Minnesota State College 
research have, hopefully, contributed to the information on 
dropouts. 

— Information regarding the dependence-independence 
of parental financial support appears to be important. 
The extent of self-support among the stopouts in the 
Minnesota State Colleges was higher than anticipated. 

— Financial difficulty, or the lack of financial resources, 
was among the three or four most frequently cited 
reasons for withdrawal. However, when the total group 
of dropouts was differentiated by sex and academic 
average, the lack of financial resources was the 
dominant reason for withdrawal of only one group — 
men with satisfactory academic averages. 

— Students with unsatisfactory academic averages tend to 
view their college experience in negative ways. While 
they perhaps correctly attribute their primary reason 
for leaving college as an unsatisfactory academic 
average. Ihc worry and fear of failuro apparently spills 
over into an unhappincss with the college experience 
and a disappointment with the academic program. A 
lack of financial resources was ranked fourth by 
students with unsatisfactory averages, so we can 
assume that they were not primarily worried about 
their financial ability to remain in college. 

— Information regarding student attitudes toward the 
academic program provides a means of assessing 
consumer response to the academic fare. The educa- 
tional experiences identified as significantly positive 
or negative, and the reasons for these comments, 
should be explored to identify possible areas of curri- 
cular or instructional change. For example, there may 
be areas of the academic program which students with 
certain important characteristics, such as the voluntary 
Withdrawals, believe the college is doing well, and 
areas which might be improved. The findings may then 
be used to support alternative cuiricular programs 
designed to more adequately satisfy student needs. 
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